{"id":32621,"date":"2023-06-23T03:00:00","date_gmt":"2023-06-23T10:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=32621"},"modified":"2023-07-06T12:53:18","modified_gmt":"2023-07-06T19:53:18","slug":"book-review-the-kaggle-book-workbook","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/06\/23\/book-review-the-kaggle-book-workbook\/","title":{"rendered":"Book Review: The Kaggle Book\/Workbook"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

Kaggle<\/a> (acquired by Google<\/a> in 20217) is an incredible resource for all data scientists. The company promotes itself as “the home of data science.” I advise my Intro to Data Science students at UCLA to take advantage of Kaggle by first completing the venerable Titanic<\/a> Getting Started Prediction Challenge<\/em>, and then moving on to active challenges. Kaggle is a great way to gain valuable experience with data science and machine learning. Now, there are two excellent books to lead you through the Kaggle process. The Kaggle Book<\/a> by Konrad Banachewicz and Luca Massaron published in 2022, and The Kaggle Workbook<\/a> by the same authors published in 2023, are both from UK-based Packt Publishing. <\/p>\n\n\n\n

Let’s start with The Kaggle Book<\/em>. The book is an invaluable learning resource for anyone participating in a Kaggle competition, as well as pretty much any data scientist wishing to sharpen his\/her skills. Reading the book is like doing a Vulcan mind-meld with Kaggle Masters and Grandmasters; you get an instant appreciation for how these experts have done so well in the Kaggle ecosystem. This is achieved in a number of ways: through their winning Python code, through their detailed interview sidebars spread throughout the book, and through selected links pointing to important Kaggle discussions. This last feature of the book maybe the most useful as some of the discussions offer insights that you won’t find anywhere else. For example, Grandmaster Michael Jahrer famous post<\/a> on denoising autoencoders is featured in Chapter 7. Reading his detailed explanations for how he won 1st place in the Porto Seguro’s Safe Driver Prediction competition is an excellent way to add to your own data science toolbox. Chapter 7 also included an insightful interview with well-known Kaggler Bojan Tunguz who is a huge proponent of XGBoost on Twitter<\/a>. <\/p>\n\n\n\n

The book also offers strategic references to many Kaggle competitions that illustrate critical methods for ensuring machine learning success. For example, Chapter 5 includes references to a number of competitions for which AUC was used for determining classification accuracy. You can have fun bouncing from project to project to better understand important principles in machine learning. The book serves as a guide map for such explorations. The result is a much better understanding for how to approach projects moving forward. <\/p>\n\n\n\n

One of my favorite chapters is Chapter 5 on Metrics since when it comes right down to it, you need a firm stable of techniques with which to judge the performance of your ML solutions. Another favorite is Chapter 8 on Hyperparameter Optimization. Using the best and most powerful algorithms is one thing, but knowing how to optimize a model’s many hyperparameter is quite another. Although the book doesn’t address the mathematical foundations for the algorithms and their hyperparameters, it does provide insights into finding the the best hyperparameters for your models. Seeing how Grandmasters address the hyperparameter problem is quite valuable. I also enjoyed Chapter 7 on modeling tabular data, i.e. business data. Here are discussions of important topics like dimensionality reduction, feature engineering, and using neural networks for tabular data. <\/p>\n\n\n\n

The balance of the book includes useful topics like: an introduction to Kaggle datasets, working with Kaggle notebooks, leveraging Kaggle discussion forums, as well as popular topics like computer vision and NLP. This book is a great way to tame the complex Kaggle infrastructure, and I can’t image proceeding with a Kaggle competition without this book by your side. <\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

A very nice adjunct to The Kaggle Book, is The Kaggle Workbook<\/em> that contains just four chapters, each having a thorough review of past Kaggle challenges which can be viewed as self-leaning exercises containing valuable insights for Kaggle data science competitions. Each of the 4 chapters includes Python source code for the solution. The code is designed to run on a Kaggle notebook. Here is a list of the projects:<\/p>\n\n\n\n