Welcome!
  Post Categories
data science 117 search 1 data engineering 173 machine learning 6 optimization 3 Metaverse 1 physics 3 stack overflow 1 image processing 3 algorithm 13 VR 1 fintech 7 web3 1
Two Ways of Enforcing and Validating Python class input using Pydantic Two Ways of Enforcing and Validating Python class input using Pydantic
Pydantic is a Python library used for data parsing and validation through Python type annotations. It’s particularly use
2024-01-27 data engineering
python pydantic
Add relative path to system path in Python Add relative path to system path in Python
When runing pyton scripts, in order to import function from some file, we need to make sure that file is in the system p
2024-01-16 data engineering
python
Pyspark topandas operation too slow, and what to do next Pyspark topandas operation too slow, and what to do next
topandas() is a method in PySpark that converts a Spark DataFrame to a Pandas DataFrame. If you find that topandas() is
2024-01-08 data engineering
spark pyspark
Understanding Python's TypeError, Missing 1 required positional argument Understanding Python's TypeError, Missing 1 required positional argument
Python error sometimes can be confusing, especially for beginners. A common source of confusion is the TypeError related
2024-01-05 data engineering
python
Automating AWS Infrastructure and CI/CD with Terraform and GitHub Actions Automating AWS Infrastructure and CI/CD with Terraform and GitHub Actions
We dive into the world of infrastructure automation and continuous integration/continuous deployment (CI/CD) using Terra
2024-01-04 data engineering
github action terraform
Robust functin return format in Python Robust functin return format in Python
In Python, when you see a function returning result or {}, it means that the function is designed to return either the v
2023-12-29 data engineering
python
Rendering html file using streamlit app Rendering html file using streamlit app
If we have some static html, probably with some javascript as well, we can deploy the html and use streamlit app to rend
2023-12-27 data engineering
streamlit
How to use secrets in streamlit app safely How to use secrets in streamlit app safely
When using streamlit app, how to manage secrets? It is quite easy to use st.secrets function. when running your Streaml
2023-12-27 data engineering
streamlit
Understanding POST vs PUT in Web Development Understanding POST vs PUT in Web Development
When we use web services, sometimes it may trigger error when we are not careful to tell the difference between POST and
2023-12-22 data engineering
http web development
How to setup AWS opensearch with master user mode and indexing in Python How to setup AWS opensearch with master user mode and indexing in Python
AWS opensearch is AWS’s version of elasticserch. For faster development and easy interaction with AWS opensearch service
2023-12-19 data engineering
elasticsearch opensearch
Use Orbstack as a fast and free alternative as docker desktop Use Orbstack as a fast and free alternative as docker desktop
Docker is very useful, but for big company it may needs to pay to use docker desktop. One good solution is to install Or
2023-12-16 data engineering
docker orbstack
What is asterisk in python class o function argument list What is asterisk in python class o function argument list
We see asterisk in some python class or function argumentlist, what does it mean? What are Keyword-Only Arguments?Introd
2023-12-09 data engineering
python
3 / 15