Welcome!
A transformer example to maintain same feature order and add missing features back for feature engineering A transformer example to maintain same feature order and add missing features back for feature engineering
For data science projects, one important steps in feature engineering is to make sure the order of feature columns durin
2022-01-27 data science
pipeline transformer scikit-learn
Convert short texts to numeric vectors with Character ngram tf-idf vectorizer using scikit learn in Python Convert short texts to numeric vectors with Character ngram tf-idf vectorizer using scikit learn in Python
When apply machine learning algorithms, to handel words or short texts, we usually need to get their numeric embedding v
2022-01-15 machine learning
text mining natural language processing
Use Python to solve Linear Programming optimization problem Use Python to solve Linear Programming optimization problem
Let’s first define the standard format of linear programming problem,in which we will minimize the following equation$$
2021-12-29 optimization
linear programming optimization
Multi-class classification using simple deep learning structure in Pytorch with iris dataset Multi-class classification using simple deep learning structure in Pytorch with iris dataset
As one can see from the following example, it is very easy to apply deep learning structure in Pytorchto perform multi-c
2021-12-26 machine learning
multi-class classification pytorch
How to auto run python jobs using crontab How to auto run python jobs using crontab
In ubuntu Linux，many times we need to run certain tasks regularly, such as every 10 minutes, at 2 o’clock in the morning
2021-10-24 data engineering
crontab
How to serve the Flask app with nginx as the reverse proxy How to serve the Flask app with nginx as the reverse proxy
We are going to build a simple and smooth process using the following steps: if you don’t have uwsgi installed, try th
2021-10-01 data engineering
flask app nginx
Set up Flask app to implement GET and POST API Set up Flask app to implement GET and POST API
Flask app is one of the easiest ways to setup APIs on the server side for data engineering and data science purpose.Here
2021-09-29 data engineering
flask app API
Data Prep and Visualization Example using matplotlib in Python Data Prep and Visualization Example using matplotlib in Python
Some simple ways to make histogram or line plots using matplotlib. # Install the pydataset package. This package gives u
2021-08-25 data science
matplotlib tips
Add ssh key to access github and simple git commands Add ssh key to access github and simple git commands
Here are ways to add ssh key in Github, such that one can connect to github repositories without typing username and pas
2021-08-23 data science
git and github
overlay histogram distributions using seaborn or matplotlib overlay histogram distributions using seaborn or matplotlib
In this example, we show two methods to overlay histogram distributions using seaborn and matplotlib separately. import
2021-07-26 data science
seaborn tips
robust method to parse time string to datetime using dateutil parser robust method to parse time string to datetime using dateutil parser
Convert time strings into datetime format coudd be very tedious, because we need to make sure the every new datafollow t
2021-07-14 data science
preprocessing feature extraction
dataframe histogram visualization with seaborn using countplot dataframe histogram visualization with seaborn using countplot
We often need to plot histograms to visualize distributions of certain features or variables.How to quickly obtain a use
2021-07-06 data science
visualization seaborn tips
27 / 28