fix: linting and ci issues
This commit is contained in:
2
.github/workflows/ci.yml
vendored
2
.github/workflows/ci.yml
vendored
@@ -62,7 +62,7 @@ jobs:
|
||||
- name: Prettier check
|
||||
run: |
|
||||
prettier --check \
|
||||
"**/*.yml" "**/*.yaml" "**/*.json" "**/*.md" \
|
||||
"**/*.yml" "**/*.yaml" "**/*.md" \
|
||||
--ignore-path .prettierignore
|
||||
|
||||
# ── Tests ────────────────────────────────────────────────────────────────
|
||||
|
||||
@@ -4,6 +4,7 @@ dbt/dbt_packages/
|
||||
.venv/
|
||||
dist/
|
||||
*.egg-info/
|
||||
.pytest_cache/
|
||||
|
||||
# Dagster storage
|
||||
dagster_home/storage/
|
||||
|
||||
@@ -3,7 +3,8 @@ templater = jinja
|
||||
dialect = postgres
|
||||
max_line_length = 100
|
||||
# Exclude generated/vendor paths
|
||||
exclude_rules = RF05 # don't require quoted identifiers
|
||||
# Don't require quoted identifiers
|
||||
exclude_rules = RF05
|
||||
output_line_length = 120
|
||||
|
||||
[sqlfluff:templater:jinja]
|
||||
|
||||
6
Makefile
6
Makefile
@@ -95,15 +95,15 @@ lint-python: ## Ruff lint + format check
|
||||
lint-sql: ## SQLFluff lint on dbt/models
|
||||
uv run sqlfluff lint dbt/models --dialect postgres
|
||||
|
||||
lint-format: ## Prettier check (YAML / JSON / Markdown)
|
||||
npx --yes prettier --check "**/*.yml" "**/*.yaml" "**/*.json" "**/*.md" \
|
||||
lint-format: ## Prettier check (YAML / Markdown)
|
||||
npx --yes prettier --check "**/*.yml" "**/*.yaml" "**/*.md" \
|
||||
--ignore-path .prettierignore
|
||||
|
||||
lint-fix: ## Auto-fix all linters (ruff + sqlfluff + prettier)
|
||||
uv run ruff check --fix .
|
||||
uv run ruff format .
|
||||
uv run sqlfluff fix dbt/models --dialect postgres
|
||||
npx --yes prettier --write "**/*.yml" "**/*.yaml" "**/*.json" "**/*.md" \
|
||||
npx --yes prettier --write "**/*.yml" "**/*.yaml" "**/*.md" \
|
||||
--ignore-path .prettierignore
|
||||
|
||||
## —— Pre-commit ────────────────────────────────────────────────
|
||||
|
||||
18
README.md
18
README.md
@@ -1,17 +1,17 @@
|
||||
# data-platform
|
||||
|
||||
A [Dagster](https://dagster.io/) + [dbt](https://www.getdbt.com/) data platform,
|
||||
managed with [uv](https://github.com/astral-sh/uv) and deployed via Docker Compose.
|
||||
A [Dagster](https://dagster.io/) + [dbt](https://www.getdbt.com/) data platform, managed with
|
||||
[uv](https://github.com/astral-sh/uv) and deployed via Docker Compose.
|
||||
|
||||
## Stack
|
||||
|
||||
| Layer | Tool |
|
||||
|---|---|
|
||||
| Orchestration | Dagster (webserver + daemon) |
|
||||
| Transformation | dbt-core + dbt-postgres |
|
||||
| Storage | PostgreSQL 16 |
|
||||
| Package/venv | uv |
|
||||
| Secrets | `.env` file |
|
||||
| Layer | Tool |
|
||||
| -------------- | ---------------------------- |
|
||||
| Orchestration | Dagster (webserver + daemon) |
|
||||
| Transformation | dbt-core + dbt-postgres |
|
||||
| Storage | PostgreSQL 16 |
|
||||
| Package/venv | uv |
|
||||
| Secrets | `.env` file |
|
||||
|
||||
## Project layout
|
||||
|
||||
|
||||
@@ -1,3 +1 @@
|
||||
from data_platform.definitions import defs
|
||||
|
||||
__all__ = ["defs"]
|
||||
"""data_platform – Dagster + dbt data platform."""
|
||||
|
||||
@@ -9,10 +9,10 @@ staged as (
|
||||
global_id,
|
||||
price,
|
||||
human_price,
|
||||
date as price_date,
|
||||
timestamp as price_timestamp,
|
||||
source as price_source,
|
||||
status as price_status,
|
||||
date as price_date,
|
||||
timestamp as price_timestamp,
|
||||
source as price_source,
|
||||
status as price_status,
|
||||
ingested_at
|
||||
from source
|
||||
)
|
||||
|
||||
Reference in New Issue
Block a user