Skip to main content

do machine learning experts use more maths or more libraries?

I don't consider myself a machine learning expert yet, but I have had quite a bit of experience working with machine learning experts and veterans in my yet short career. Some of them have done PhD in mathematics while some others have worked extensively as senior software engineers. And therefore, I think it is easy for me to answer whether machine learning experts use more math or more libraries.

The answer which you didn't expect!

They use more libraries and read more maths. If you call a person machine learning experts if he/she can do a lot of machine learning work efficiently, they certainly expertise in both options. Generally, machine learning experts are handed over more open-ended problems, which require both theoretical solution of them as well as building thorough pipelines for cleaning, feature processing, modeling, tuning and interpretable results and visualization creation. And a person who can do so, surely needs a lot of experience in maths, libraries and frameworks.

In terms of maths, every machine learning veteran knows their fair share of statistics, numerical approximations, algorithms and even more core mathematics like analysis, functional analysis, topologies and others. If you meet an experienced person of such type,you will notice that they often read up on good mathematics books focusing on numerical expertise or statistics. These are the habits experts grow to stay on track with the mathematics part of what is growing in the software.

These same people also use lot of libraries in their work so that they do not end up unnecessary codes. It is customary in software to write small, efficient code which are optimized, fast and easy to read. So experts tend to use as much as standard libraries as possible. But they often write custom code because more than often, standard libraries don't fit best in custom machine learning projects.

Conclusion:

So in conclusion, machine learning experts use more libraries in their code, while they read more maths than your average machine learning engineers, to stay ahead of the curve, create and contribute to things. So, if you aspire to become a machine learning expert, then you need to up your game in both maths and software. Stay tuned and subscribe to my blog for technical contents.

Labels:

Comments

Post a Comment

Popular posts from this blog

Mastering SQL for Data Science: Top SQL Interview Questions by Experience Level

Introduction: SQL (Structured Query Language) is a cornerstone of data manipulation and querying in data science. SQL technical rounds are designed to assess a candidate’s ability to work with databases, retrieve, and manipulate data efficiently. This guide provides a comprehensive list of SQL interview questions segmented by experience level—beginner, intermediate, and experienced. For each level, you'll find key questions designed to evaluate the candidate’s proficiency in SQL and their ability to solve data-related problems. The difficulty increases as the experience level rises, and the final section will guide you on how to prepare effectively for these rounds. Beginner (0-2 Years of Experience) At this stage, candidates are expected to know the basics of SQL, common commands, and elementary data manipulation. What is SQL? Explain its importance in data science. Hint: Think about querying, relational databases, and data manipulation. What is the difference between WHERE
Post a Comment
Read more

What is Bort?

 Introduction: Bort, is the new and more optimized version of BERT; which came out this october from amazon science. I came to know about it today while parsing amazon science's news on facebook about bort. So Bort is the newest addition to the long list of great LM models with extra-ordinary achievements.  Why is Bort important? Bort, is a model of 5.5% effective and 16% total size of the original BERT model; and is 20x faster than BERT, while being able to surpass the BERT model in 20 out of 23 tasks; to quote the abstract of the paper,  ' it obtains performance improvements of between 0 . 3% and 31%, absolute, with respect to BERT-large, on multiple public natural language understanding (NLU) benchmarks. ' So what made this achievement possible? The main idea behind creation of Bort is to go beyond the shallow depth of weight pruning, connection deletion or merely factoring the NN into different matrix factorizations and thus distilling it. While methods like knowle
Post a Comment
Read more

Spacy errors and their solutions

 Introduction: There are a bunch of errors in spacy, which never makes sense until you get to the depth of it. In this post, we will analyze the attribute error E046 and why it occurs. (1) AttributeError: [E046] Can't retrieve unregistered extension attribute 'tag_name'. Did you forget to call the set_extension method? Let's first understand what the error means on superficial level. There is a tag_name extension in your code. i.e. from a doc object, probably you are calling doc._.tag_name. But spacy suggests to you that probably you forgot to call the set_extension method. So what to do from here? The problem in hand is that your extension is not created where it should have been created. Now in general this means that your pipeline is incorrect at some level.  So how should you solve it? Look into the pipeline of your spacy language object. Chances are that the pipeline component which creates the extension is not included in the pipeline. To check the pipe eleme
Post a Comment
Read more