alex_p/yt-dlp-dags
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 4fd9217c6d Updates on single source of profile list in cluster.yaml, fix single tmux worker naming, updates ytops to support workers without profile list main aperez 2026-01-16 11:01:35 +03:00
  • bf12118b2b Updates on centralized of configuration to cluster.xml aperez 2026-01-13 11:47:21 +03:00
  • 93d485db08 Updates on centralized of configuration to cluster.xml aperez 2026-01-13 11:47:21 +03:00
  • 7a514ab8ce Update ansible works with auth and downloads on dl machine, while enforcer on master aperez 2026-01-11 01:21:25 +03:00
  • db78171281 Migrate implementation to state machine support aperez 2026-01-03 22:36:05 +03:00
  • efac6cf1fb Add cleanup, ffmpeg, changes on prefixes per worker, load balance on enforccer, dummy updates mode aperez 2025-12-30 09:47:03 +03:00
  • 5479e8c8f8 Updates over task generator usage aperez 2025-12-27 16:57:26 +03:00
  • fa7c46f671 Update chrome versions and remove XDG duplicates aperez 2025-12-26 14:09:39 +03:00
  • e284099eee Added readme with example of ansible aperez 2025-12-26 13:49:38 +03:00
  • ab23cca903 Update dummy examples of cluster files aperez 2025-12-26 13:41:11 +03:00
  • 561eac8a7e Fix DataOK download reset after COOLDOWN aperez 2025-12-26 13:38:12 +03:00
  • 02132f1732 Update policies on proper queue reading aperez 2025-12-26 12:57:15 +03:00
  • 65561579d8 Update basic install to bypass break system packages with pip incompatibility aperez 2025-12-26 10:54:34 +03:00
  • 81f9739ea7 Update to ytops_client for docker direct aperez 2025-12-26 10:05:00 +03:00
  • 0103d13c3f Current changes on ytops docker direct invocation in batch mode aperez 2025-12-25 14:32:53 +03:00
  • 9d2187ad3c Local changes over multiple fixes, to skip url on bad formats, to allow send to aria2c service, to adopt ban cli policy testing, pass throught lang and headers from airflow dags if needed aperez 2025-12-01 20:27:50 +03:00
  • 336438d4cc Local changes over multiple fixes, to skip url on bad formats, to allow send to aria2c service, to adopt ban cli policy testing, pass throught lang and headers from airflow dags if needed aperez 2025-12-01 20:27:50 +03:00
  • 302282365e Updated due to different af-green install issues aperez 2025-11-24 10:22:22 +03:00
  • 451f349904 Added urls rt for deploy, and update clear of celery queue to prevent running after dispatch pause dag aperez 2025-11-23 19:58:43 +03:00
  • 61873b46f9 Added changes on s3 uploaded and ansible changes tested on af-test machines, deprecation of camoufox run aperez 2025-11-23 17:23:51 +03:00
  • 3709ba6f81 Updates during migration some fixes on formats aperez 2025-11-20 09:21:25 +03:00
  • 0ead029b85 Updates on minio, envoy ports on master, adding ytops_client aperez 2025-11-19 10:37:09 +03:00
  • f151ffee86 Updated current version of v1 and v2 dags, bin/ytops_client, ansible individual services aperez 2025-11-17 17:18:47 +03:00
  • 52a2d6290d Update task pinning and default client list to tv_sample,mweb calls aperez 2025-09-22 15:57:43 +03:00
  • 4605e0e6a5 Updates on task pining and permissions, with pause ansible aperez 2025-09-20 00:31:40 +03:00
  • 6e90ab2673 Add pause/resume tasks aperez 2025-09-17 13:06:37 +03:00
  • 2786f5ba72 Some updates, mostly problems with postgres permissions and logs permissions, mess with improper master management service processing from .env aperez 2025-09-17 12:04:11 +03:00
  • b3fee7eec2 Exclude cache folder on aider aperez 2025-09-15 11:41:09 +03:00
  • ea4f4c7aea Updated from external repo on ansible deploy aperez 2025-09-15 11:10:29 +03:00
  • 9fd06b4a7b Partial commits from internal repo on deployment changes aperez 2025-09-05 17:59:07 +03:00
  • 3e78556032 fix: sync airflow.cfg during ansible deployment to ensure latest config is used aperez 2025-08-29 17:27:20 +03:00
  • 2be7716bed feat: complete Ansible corrected file paths and removed redundant files aperez 2025-08-27 02:32:27 +03:00
  • 7b13257bd1 Remove unused dags aperez 2025-08-26 19:25:31 +03:00
  • de609aaecd Remove intermediate aperez 2025-08-26 19:19:31 +03:00
  • b3f8597e81 Recopy after ansible move aperez 2025-08-26 18:00:55 +03:00
  • 182deac14e Update dags for multi worker aperez 2025-08-15 18:00:26 +03:00
  • 4455a10726 Updated dags with queue and hosts aperez 2025-08-07 18:01:23 +03:00
  • 274bef5370 Provide updates on ytdlp dags aperez 2025-08-06 18:02:44 +03:00
  • 61906a57ef Migrate to new dags and add proxy banning, sensor / worker in dags aperez 2025-07-25 17:59:24 +03:00
  • fc2d740b65 Updated utils for reuse redis connects aperez 2025-07-18 17:19:07 +03:00
  • 1f186fd217 Update Readme and ytdlp dags aperez 2025-07-18 17:17:19 +03:00
  • affc59ee57 Update dags to pull by trigger or periodically aperez 2025-07-18 16:24:09 +03:00
  • 6989d49da3 Added dags on queue management and camoufox support aperez 2025-04-13 18:14:42 +03:00
  • 1f092d6f80 Update on --probe and add experimental service dags aperez 2025-04-06 11:55:53 +03:00
  • 516eff4ac1 Update readme and version files aperez 2025-04-03 13:40:46 +03:00
  • 8390c8172a Update readme with more explicit instructions on pull and build aperez 2025-04-03 13:33:36 +03:00
  • 8b689fc5c8 Upload client service dags aperez 2025-04-03 13:25:49 +03:00