#Software
名詞用法
State | Status | |
---|---|---|
定義 | 表示具備明確轉換流程的狀態 | 表示單一、靜態的狀態或屬性 |
轉換關係 | 狀態之間有明確的遷移關係 | 狀態之間沒有明確的轉換流程 |
範例 | TCP 狀態(SYN_SENT、ESTABLISHED 等) | HTTP 狀態碼(200、404 等)、啟用/停用標記 |
Meaning of Abbreviations
Shortcut | Description |
---|---|
PR | Pull Request |
PTAL | Please Take A Look |
TBR | To Be Reviewed |
TL;DR | Too Long; Didn’t Read |
LGTM | Looks Good To Me |
SGTM | Sounds Good To Me |
TBD | To Be Done |
Docker
Installation
- 適用於Ubuntu與WSL的Nvidia Docker安裝方式
- Tensorflow with GPU on Windows WSL using Docker
- 【技術分享】重灌後,安裝 GPU 驅動以及 Docker
- Manage Docker as a non-root user
Setup
- How to Use a .dockerignore File: A Comprehensive Guide with Examples
- How to use Docker Build Args and Environment Variables
docker network-alias
docker stopsignal
Book or Video
Error
- Docker Desktop WSL ext4.vhdx too large
- 設定 super user - nvidia-docker :权限被拒绝
- Docker image platform compatibility issue with MAC Silicon processors(M1/M2)
- Solution for docker: invalid reference format: repository name must be lowercase
- when using docker compose 3.8 getting ‘version is unsupported’ error
#Python
Design Pattern
基本
- Python 寫程式的「底線」:7 種使用技巧
- Abstract Method - [Python物件導向]Python多型(Polymorphism)實用教學
- geoff_spacetime/變數命名慣例
State Design Pattern
Class
- Python dataclass 教學:輕鬆定義資料類別
- Python Property 教學:保護變數資料的 Getter 與 Setter
- Python Type Hints 教學:我犯過的 3 個菜鳥錯誤
- Pydantic: Simplifying Data Validation in Python
Enum
Documentation
Project
- astral-sh/uv
An extremely fast Python package installer and resolver, written in Rust.
- astral-sh/rye
a Hassle-Free Python Experience
- cookiecutter
A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C projects.
- pypa/hatch
Modern, extensible Python project management
Flow Chart
Pipeline
#Database
#Julia
#SRE Site Reliability Engineering
#CI/CD
Version Control
Distributed Version Control System,DVCS
Center Version Control System
Team Foundation Version Control, TFVC
git
DVC
ML Experiments Management with Git
- Data Version Control | Git for Data & Models | ML Experiments Management
- Data Version Control With Python and DVC
elementary
Open-source data observability for analytics engineers
Workflow/Pipeline/MLops
Crontab
Jenkins
Github action
- What’s the difference between a GitHub action and a workflow?
- Actionforge is a VS Code Extension to Build GitHub Workflows Visually
Airflow
mage-ai
The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
wandb
A tool for visualizing and tracking your machine learning experiments.
Drone CI
Flyte
- An open-source orchestrator that facilitates building production-grade data and ML pipelines
datachecks
Datachecks is an open-source data monitoring tool that helps to monitor the data quality of databases and data pipelines. It identifies potential issues, including in the databases and data pipelines. It helps to identify the root cause of the data quality issues and helps to improve the data quality.
#git
Command
# 列出所有曾經有 commit 過的文件
git log --pretty=format: --name-only --diff-filter=A | sort -u
# 刪除所有跟 a.txt 相關的紀錄
git filter-branch --force --index-filter 'git rm --cached --ignore-unmatch a.txt' --prune-empty --tag-name-filter cat -- --all
Commit message Convention
Type | Description |
---|---|
feat | Add new features |
chore | Build process or auxiliary tool changes |
fix | Fix some bugs |
refactor | A code change that neither fixes a bug or adds a feature |
style | Change coding style |
docs | Write new documentation |
Branch Naming Convention
Type | Description |
---|---|
wip | Works in progress |
feat | Feature |
bug | Bug fix or experiment |
junk | Throwaway branch created to experiment |