Nand Kishor Contributor

Nand Kishor is the Product Manager of House of Bots. After finishing his studies in computer science, he ideated & re-launched Real Estate Business Intelligence Tool, where he created one of the leading Business Intelligence Tool for property price analysis in 2012. He also writes, research and sharing knowledge about Artificial Intelligence (AI), Machine Learning (ML), Data Science, Big Data, Python Language etc... ...

Full Bio 
Follow on

Nand Kishor is the Product Manager of House of Bots. After finishing his studies in computer science, he ideated & re-launched Real Estate Business Intelligence Tool, where he created one of the leading Business Intelligence Tool for property price analysis in 2012. He also writes, research and sharing knowledge about Artificial Intelligence (AI), Machine Learning (ML), Data Science, Big Data, Python Language etc...

3 Best Programming Languages For Internet of Things Development In 2018
742 days ago

Data science is the big draw in business schools
915 days ago

7 Effective Methods for Fitting a Liner
925 days ago

3 Thoughts on Why Deep Learning Works So Well
925 days ago

3 million at risk from the rise of robots
925 days ago

Top 10 Hot Artificial Intelligence (AI) Technologies
340716 views

2018 Data Science Interview Questions for Top Tech Companies
93435 views

Want to be a millionaire before you turn 25? Study artificial intelligence or machine learning
88077 views

Here's why so many data scientists are leaving their jobs
87981 views

Google announces scholarship program to train 1.3 lakh Indian developers in emerging technologies
68301 views

50 Questions to Test True Data Science Knowledge

By Nand Kishor |Email | Mar 21, 2018 | 23379 Views

This was the subject of a popular discussion recently posted on Quora: 20 questions to detect a fake data scientist. We asked our own data scientist, and he came up with a very different set of questions: compare his answer (#1 below - 20 questions) with Quora replies (#2 and #3 below - 30 questions). Note that #2 focuses on statistics, and #3 on architecture. The link to the original Quora discussion is also provided in this article. Which questions would you add or remove?

Many other related interview questions and answers (data science, R, Python and so on) can be found here.

1. Answer from our data scientist (many of these questions are open questions):
  1. What is the life cycle of a data science project?
  2. How do you measure yield (over base line) resulting from a new or refined algorithm or architecture?
  3. What is cross-validation? How to do it right?
  4. Is it better to design robust or accurate algorithms?
  5. Have you written production code? Prototyped an algorithm? Created a proof of concept?
  6. What is the biggest data set you have worked with, in terms of training set size, and in terms of having your algorithm implemented in production mode to process billions of transactions per day / month / year?
  7. Name a few famous API's (for instance Google search). How would you create one?
  8. How to efficiently scrape web data, or collect tons of tweets?
  9. How to optimize algorithms (parallel processing and/or faster algorithm: provide examples for both)
  10. Examples of NoSQL architecture?
  11. How do you clean data?
  12. How do you define / select metrics? Have you designed and used compound metrics?
  13. Examples of bad and good visualizations?
  14. Have you been involved - as an adviser or architect - in the design of dashboard or alarm systems?
  15. How frequently an algorithm must be updated? What about lookup tables in real-time systems?
  16. Provide examples of machine-to-machine communication.
  17. Provide examples where you automated a repetitive analytical task.
  18. How do you assess the statistical significance of an insight?
  19. How to turn unstructured data into structured data?
  20. How to very efficiently cluster 100 billion web pages, for instance with a tagging or indexing algorithm? 
  21. If you were interviewing a data scientist, what questions would you ask her?
2. This answer was posted on Quora by Jay Verkuilen:
  1. Explain what regularization is and why it is useful. What are the benefits and drawbacks of specific methods, such as ridge regression and LASSO?
  2. Explain what a local optimum is and why it is important in a specific context, such as k-means clustering. What are specific ways for determining if you have a local optimum problem? What can be done to avoid local optima?
  3. Assume you need to generate a predictive model of a quantitative outcome variable using multiple regression. Explain how you intend to validate this model.
  4. Explain what precision and recall are. How do they relate to the ROC curve?
  5. Explain what a long tailed distribution is and provide three examples of relevant phenomena that have long tails. Why are they important in classification and prediction problems?
  6. What is latent semantic indexing? What is it used for? What are the specific limitations of the method?
  7. What is the Central Limit Theorem? Explain it. Why is it important? When does it fail to hold?
  8. What is statistical power?
  9. Explain what resampling methods are and why they are useful. Also explain their limitations.
  10. Explain the differences between artificial neural networks with softmax activation, logistic regression, and the maximum entropy classifier.
  11. Explain selection bias (with regards to a dataset, not variable selection). Why is it important? How can data management procedures such as missing data handling make it worse?
  12. Provide a simple example of how an experimental design can help answer a question about behavior. For instance, explain how an experimental design can be used to optimize a web page. How does experimental data contrast with observational data.
  13. Explain the difference between "long" and "wide" format data. Why would you use one or the other?
  14. Is mean imputation of missing data acceptable practice? Why or why not?
  15. Explain Edward Tufte's concept of "chart junk." 
  16. What is an outlier? Explain how you might screen for outliers and what you would do if you found them in your dataset. Also, explain what an inlier is and how you might screen for them and what you would do if you found them in your dataset.
  17. What is principal components analysis (PCA)? Explain the sorts of problems you would use PCA for. Also explain its limitations as a method.
  18. You have data on the duration of calls to a call center. Generate a plan for how you would code and analyze these data. Explain a plausible scenario for what the distribution of these durations might look like. How could you test (even graphically) whether your expectations are borne out?
  19. Explain what a false positive and a false negative are. Why is it important to differentiate these from each other? Provide examples of situations where (1) false positives are more important than false negatives, (2) false negatives are more important than false positives, and (3) these two types of errors are about equally important.
  20. Explain likely differences encountered between administrative datasets and datasets gathered from experimental studies. What are likely problems encountered with administrative data? How do experimental methods help alleviate these problems? What problems do they bring?
3. Kavita Ganesan offered this answer:
  1. What is a gold standard ?  Believe it or not there are data scientists (even at very senior levels) who claim to know a hell lot about supervised machine learning and know nothing about what a gold standard is!
  2. What is the difference between supervised learning and unsupervised learning? - Give concrete examples.
  3. What does NLP stand for? Some data scientists claim to also do NLP.  
  4. Write code to count the number of words in a document using any programming language. Now, extend this for bi-grams. I have seen a senior level data scientist who actually struggled to implement this. 
  5. What are feature vectors?
  6. When would you use SVMs vs Random Forrest and Why?
  7. What is your definition of Big Data, and what is the largest size of data you have worked with? Did you parallelize your code? If their notion of big data is just volume - you may have a problem. Big Data is more than just volume of data. If the largest size of data they have worked with is 5MB - again you may have a problem.
  8. How do you work with large data sets?
  9. If the answer only comes out as hadoop it clearly shows that their view of solving problems is extremely narrow. Large data problems can be solved with: 1. efficient algorithms 2. multi-threaded applications 3. distributed programming 4. more...
  10. Write a mapper function to count word frequencies (even if its just pseudo code)
  11. Write a reducer function for counting word frequencies (even if its just pseudo code)
You can find the original contribution here.

Source: DSC