136 Commits

Author SHA1 Message Date
d1999b904d update requirements 2025-08-02 21:36:21 +02:00
30f08d98b6 order good deals 2025-08-02 21:14:43 +02:00
076dda0ee7 custom run launcher for custom docker image 2025-08-02 21:13:41 +02:00
94dcdd04a7 custom run launcher for custom docker image 2025-08-02 21:06:42 +02:00
b1d115fe80 scaffold nearby charging sites logic 2025-08-02 10:51:01 +02:00
6bd5e6d571 reduce sensor frequency 2025-08-02 10:50:13 +02:00
b5f7952c07 dynamic partition names 2025-08-02 10:49:56 +02:00
2a032cf25d add names for code locations 2025-08-02 10:37:41 +02:00
1d7df06dcf handle missing partitions 2025-07-30 21:53:10 +02:00
02db619c6d store and register scrape 2025-07-29 17:22:42 +02:00
0539dd9f7e move partition definition 2025-07-29 17:21:58 +02:00
09e6583579 experiments with materialization 2025-07-29 17:06:11 +02:00
4c59dcb8ac demo of delta lake with forked io manager 2025-07-29 15:37:37 +02:00
f59b30b9ea shared config 2025-07-29 11:38:41 +02:00
cc6beeffed use playwright Dockerfile 2025-07-29 11:31:45 +02:00
586a4ae904 use playwright to scrape stocks page 2025-07-29 11:31:26 +02:00
8aa943b0bf html io manager 2025-07-29 11:30:17 +02:00
f785a7d3b1 correct name 2025-07-29 11:29:18 +02:00
d74823960f shared base for file IO manager 2025-07-29 11:28:44 +02:00
80c0452cde linting 2025-07-29 11:27:22 +02:00
304e1f1594 remove containers after run 2025-07-29 11:26:26 +02:00
12bf5b1b87 update dependencies 2025-07-29 11:26:03 +02:00
ec00390de0 Dockerfile for playwright 2025-07-29 11:25:23 +02:00
b386a375b5 selenium snapshot 2025-07-28 22:33:31 +02:00
8329d7ed68 scaffold sensor triggered html download 2025-07-28 19:38:37 +02:00
25cccdb501 towards batch download 2025-07-28 19:37:52 +02:00
78de29e930 add tag to job 2025-07-27 18:27:06 +02:00
e4dddd0400 put vinyl assets under key 2025-07-27 18:17:56 +02:00
8e8b6190b9 remove test code 2025-07-27 18:16:36 +02:00
62efbb4a41 adjust concurrency 2025-07-27 18:12:48 +02:00
1e9078fed5 add asset key prefix 2025-07-27 18:06:47 +02:00
e5cb15d1ba organize weather data by retrieval time 2025-07-27 17:52:31 +02:00
662bc239f9 polars io manager ignores partition_by metadata 2025-07-27 17:51:52 +02:00
f3c2f9ec11 error handling and remove from cache 2025-07-27 16:57:59 +02:00
a8b8142402 combine sounds and plato deals, use jinja for email 2025-07-27 16:43:08 +02:00
f254afbdbb use envsubst to configure stuff in dagster.yaml 2025-07-27 15:41:10 +02:00
e756f92d54 add some dependencies 2025-07-27 15:24:04 +02:00
95b6513da9 tidy up 2025-07-27 15:23:54 +02:00
3aa6790f29 tidy up 2025-07-27 15:23:35 +02:00
05c2b33e25 it's not working 2025-07-27 15:23:25 +02:00
d1b66be636 attempt to overwrite run launch container kwargs 2025-07-27 15:22:12 +02:00
131912b70d first version of weather loader 2025-07-27 14:54:19 +02:00
d3d3911609 add mailserver settings to daemon 2025-07-27 14:50:14 +02:00
44aee9c54d store requirements files 2025-07-26 22:17:51 +02:00
fd1603e309 scaffold other code locations 2025-07-26 22:17:22 +02:00
ea4bee7186 prettier emails 2025-07-26 21:28:34 +02:00
5c188c2190 pass timezone 2025-07-26 21:22:36 +02:00
cdf5055e4f send email 2025-07-26 21:15:59 +02:00
d55cb8fb17 correct 2025-07-26 19:53:13 +02:00
329a50a5d6 find good deals 2025-07-26 19:44:39 +02:00