In this post, I want to share the complete process and setup to download files from GCP in a Databricks workspace notebook. Since the notebook itself is non-interactive when you run the shell command, the setup process is a bit different from the normal GCP authentication.

We can use the Databricks cli to interact with Databricks workspaces programmatically on the command line. In this post, I want to share simple usage about Databricks cli.

Some observation and finding in working with Databricks workspace files.

这次我来复刻手抓羊肉饭。

Using a virtual environment for Project dev in Python is a good practice. venv is module that is available since Python 3.3. It can help us to manage the virtual environment in a simple way.

A summary of different file systems in Databricks.

For array type column, explode() will convert it to n rows, where n is the number of elements in the array. For map/dictionary type column, explode() will convert it to nx2 shape, i.e., n rows, 2 columns (for key and value).

本文总结麻婆豆腐的做法。

本次来复刻台湾卤肉饭。

Some notes on developing a web application with FastAPI.

The Databricks cluster is using UTC as the default timezone. So when you run some time-related code, the displayed time is not the local time, which is not ideal. In this post, I want to share how to change the timezone setting for Databricks cluster.

In my previous post, I shared how to profile a single function using line_profiler. In this post, I want to share how to profile Python script/module and visualize the profile stat to pinpoint the slow part of the code.

家常少油版本茄子肉沫制作。

TL;DR: Lazy.nvim is amazing. It is easy to switch and reduce your startup time immensely. Just try it!

I think Packer.nvim has been a revolutionary plugin manager after nvim 0.5. It introduces a lot of lazy loading techniques to speed up the startup process of Neovim.

To extract pdf pages from several files, we can use the open source tool qpdf.

In post, I want to summarize the complete steps to deploy a demo web service implemented with FastAPI in Docker container.

When I upgrade wezterm from April release to July release, I noticed that some of the unicode icons in my neovim config are shown as box.

TL;DR: my config for pylsp can be found here.

In this post, I would like to share my latest setup for Pylsp in Neovim.

In HTTP request, same query parameter with multiple values are allowed. For example, for query parameter brand, the query string looks like this: brand=foo&brand=bar. How to parse value of this parameter to a list in FastAPI? There are several different ways.