Some tips with a practical example on how to wrap your Data Science Project in a Docker image and run it in a Docker container — When writing the code for a Data Science project, it should be portable as possible, that is, that it can be executed as many times as you want even on different machines. It often happens that a Data Science project works correctly on your machine, during the modeling and testing…

Learn to build a text classification model in Python — This article is the first of a series in which I will cover the whole process of developing a machine learning project. In this article we focus on training a supervised learning text classification model in Python. The motivation behind writing these articles is the following: as a learning data…

This project is a part of Udacity Data Science Nanodegree — Introduction Starbucks provided simulated data that mimics customer behavior on the Starbucks rewards mobile app. Once every few days, Starbucks sends out an offer to users of the mobile app. An offer can be merely an advertisement for a drink or an actual offer such as a discount or BOGO (buy…

The capstone project for Udacity’s Data Scientist Nanodegree Program — Project Overview This is a capstone project of the Data Scientist Nanodegree Program of Udacity. In this project, the given dataset contains simulated data that mimics customer behavior on the Starbucks rewards mobile app. Once every few days, Starbucks sends out an offer to users of the mobile app. An offer can…

Do Your Friends Have More Friends Than You, On Average? — Motivation On average do your friends have more friends than you? If you are an average person, there is a high chance that you have fewer friends than your friends. This is called the friendship paradox. This phenomenon states that most people have fewer friends than their friends have, on average. …

A summary of my final project in the alumni-mentored research project at Columbia University in Summer 2021: Application of Reinforcement Learning to Finance — April 4th, 2022 Update: The codes in the post and my notebook might not work anymore due to FinRL’s continuous updates. So please make sure to check out the latest information on FinRL’s GitHub when you test the idea of this post. Thank you so much for your interest!

SQL is a powerful data analysis and manipulation tool. — It is indisputable that SQL is a must-have skill for data scientists. Most companies use relational databases to store their data and SQL is what we need to interact with them. SQL stands for structured query language but it is able to perform much more than querying a database. We…

Learn how to use Kafka, Spark, Druid, and more — All signs point towards an auspicious future for data engineering. Dice’s 2020 tech jobs report cites data engineering as the fastest-growing field in 2020, increasing by a staggering 50%, while data science roles only increased by 10%. You can rest assured that the influx of data engineering jobs will not…

All the newcomers are highly welcomed — When we start working in the data science field, we usually find it challenging to get the right learning track for our practice. We have available open-source data science projects on Kaggle. But, those available open-source projects are either too tough to understand or too easy that they don’t follow…