Welcome!
  Post Categories
data science 120 search 1 data engineering 181 optimization 3 machine learning 6 Metaverse 1 physics 3 stack overflow 1 image processing 3 algorithm 13 VR 1 fintech 7 web3 1
robust method to parse time string to datetime using dateutil parser robust method to parse time string to datetime using dateutil parser
Convert time strings into datetime format coudd be very tedious, because we need to make sure the every new datafollow t
2021-07-14 data science
preprocessing feature extraction
dataframe histogram visualization with seaborn using countplot dataframe histogram visualization with seaborn using countplot
We often need to plot histograms to visualize distributions of certain features or variables.How to quickly obtain a use
2021-07-06 data science
visualization seaborn tips
multi line plot with seaborn multi line plot with seaborn
In this example, we show to do multi-plot graph using seaborn.In addtion, some of the ways to change fonts sizes are als
2021-07-01 data science
visualization seaborn tips
rare event encoding for categorical feature in machine learning in pandas dataframe rare event encoding for categorical feature in machine learning in pandas dataframe
If categorical features has too many values, it will generate too many features after encoding, such as one-hot encoding
2021-06-23 data science
preprocessing pandas tip machine learning
handles feature order in training and online production stage to avoid inconsistent error handles feature order in training and online production stage to avoid inconsistent error
In applying machine learning models in production stage, like lightGBM model or any models.While we all know the order o
2021-06-18 data science
preprocessing pandas tip machine learning
some handy functions to group continous variables and missing value imputation in dataframe some handy functions to group continous variables and missing value imputation in dataframe
Following example shows how to group age variable into groups,and some simple missing value imputaiton proecdures. There
2021-06-15 data science
python preprocessing pandas tip
explode and expand rows to multiple rows or columns to multiple columns using pandas dataframe explode and expand rows to multiple rows or columns to multiple columns using pandas dataframe
import pandas as pd generate some example some datadata = [ [['python','C'],'John'],[[&#x
2021-06-14 data science
python preprocessing pandas tip
aggregate features from different rows into one row in pandas dataframe aggregate features from different rows into one row in pandas dataframe
In many use cases, different features of the same event are stored in a table by multiple rows.multiple columns will ind
2021-06-12 data science
preprocessing pipeline feature engineering
time series feature engineering using tsfresh, training vs test time series feature engineering using tsfresh, training vs test
During the test stage, i.e., once the model is on production, for any new data,tsfresh feature generation does not depen
2021-06-10 data science
preprocessing pipeline tsfresh time series feature engineering
word tokenization and sentence tokenization in python using NLTK package word tokenization and sentence tokenization in python using NLTK package
What is Tokenization?Tokenization is the process by which a large quantity of text is divided into smaller parts called
2021-06-09 data science
tokenization NLTK
missing value or null value processing in pandas dataframe missing value or null value processing in pandas dataframe
obtain null or missing values of a dataframeSuppose the dataframe has the following formats, with 10 rows and 5 clomns:
2021-06-08 data science
pandas dataframe
how to convert timestamp column of pandas dataframe into hour and day features using transformer how to convert timestamp column of pandas dataframe into hour and day features using transformer
from sklearn.base import BaseEstimator, TransformerMixinimport pandas as pdclass dayandhour_Transformer(BaseEstimator, T
2021-06-04 data science
python pandas preprocessing
10 / 10