Welcome!
  Post Categories
data science 118 search 1 data engineering 177 machine learning 6 optimization 3 Metaverse 1 physics 3 stack overflow 1 image processing 3 algorithm 13 VR 1 fintech 7 web3 1
vector search using Elastic Search, index and search example using python requests library vector search using Elastic Search, index and search example using python requests library
Vector search has becoming very useful in deep learning applications. To search dense vectors in Elasticsearch 8.6, you
2023-03-18 data engineering
elasticsearch
Decoding JSON String When There are Single Quotes Decoding JSON String When There are Single Quotes
JSON (JavaScript Object Notation) is a popular format used for transmitting data between applications. It’s a lightweigh
2023-03-16 data engineering
python json string decoding
Scratch Your Head? Be Careful with \r or Carriage Return when Printing Strings Scratch Your Head? Be Careful with \r or Carriage Return when Printing Strings
Have you ever encountered a situation where you printed a string in Python and found that it didn’t appear as expected?
2023-03-16 data engineering
python carriage return
Expanding Array Columns in Pandas DataFrames and wrap up in scikit-learn transformer Expanding Array Columns in Pandas DataFrames and wrap up in scikit-learn transformer
Sometimes, you may find yourself working with a Pandas DataFrame that contains a column of arrays with the same length.
2023-03-15 data engineering
pandas scikit-learn
Adding progress bars and parallelize tasks in Python Adding progress bars and parallelize tasks in Python
use tqdm and pqdm in Python to add progress bars to your code and parallelize tasks. Projects in Python often involve lo
2023-03-13 data engineering
tqdm pqdm progress bars
Difference between `json` and `data` parameter of the HTTP POST Requests with JSON Data in Python using the Requests Library Difference between `json` and `data` parameter of the HTTP POST Requests with JSON Data in Python using the Requests Library
HTTP POST requests are a common way to send data to web servers from client applications. When sending JSON data as the
2023-03-12 data engineering
python requests
How to convert CURL to python requests and vice versa How to convert CURL to python requests and vice versa
curl and Python requests are both powerful tools for sending HTTP requests. While curl is a command-line tool that allow
2023-03-12 data engineering
python curl requests
How to Prettify and Visualize JSON Data in Python How to Prettify and Visualize JSON Data in Python
JSON (JavaScript Object Notation) is a lightweight data interchange format that is widely used in web applications and A
2023-03-11 data engineering
json data visualization
Difference between 'python -m pip install' and 'pip install' Difference between 'python -m pip install' and 'pip install'
Installing packages in Python can be done using the package manager pip. There are two ways to run pip to install packag
2023-02-08 data engineering
python
Logging metrics and tags of multiple models into one mlflow in Databricks Logging metrics and tags of multiple models into one mlflow in Databricks
There are situations where we need to run multiple notebooks or algorithms that are closely related. In this case, it ma
2023-02-07 data engineering
databricks
Spark SQL - Collecting Columns into Lists after Groupby Spark SQL - Collecting Columns into Lists after Groupby
In Spark SQL, you may want to collect the values of one or more columns into lists after grouping the data by one or mor
2023-02-01 data engineering
spark pyspark
In PySpark how to filter dataframe column using unique values from another dataframe In PySpark how to filter dataframe column using unique values from another dataframe
Here is one common task in PySpark: how to filter one dataframe column are from unique values from anther dataframe? Met
2023-01-22 data engineering
spark pyspark
14 / 15