196 Commits

Author SHA1 Message Date
Alex 387237d017 Update README.md 2025-01-15 02:40:51 -08:00
muskit cb921ee911 ignore privated tweets entirely (prob the reason why my scrapers get kicked) 2024-04-29 23:55:29 -07:00
muskit 85b4bfe939 add condition for unavailable tweet 2024-04-29 17:20:23 -07:00
muskit 661c9232a3 switch to latest tweety no matter what ¯\_(ツ)_/¯ 2024-04-29 17:20:08 -07:00
muskit 8ba0394e9c add no-cache build toggle line 2024-04-29 17:13:39 -07:00
muskit 6b585ad96a print ttweet object when posting 2024-04-26 00:16:16 -07:00
muskit eadf130305 fix logic error of handling finished tweets 2024-04-26 00:15:45 -07:00
muskit 24877eb53e add cross-agency case 2024-04-26 00:15:32 -07:00
muskit 8e163e26cf extend wait to try and avoid revocation (didnt work) 2024-04-26 00:14:46 -07:00
muskit f035896226 add script to access shell in container 2024-04-26 00:13:35 -07:00
muskit 034c71abbb use unbuffered stdout to fix docker logging 2024-04-26 00:13:24 -07:00
muskit bfc9066617 remove backup tweet format that excludes screenshot 2024-04-21 16:05:37 -07:00
muskit 0203578987 add preempt tweet list handling 2024-04-21 16:04:33 -07:00
muskit 99155fdb37 add .venv to avoid long image rebuilds 2024-04-21 16:03:32 -07:00
muskit d05da5bff0 add screenshots parent tweet limit 2024-04-20 12:28:39 -07:00
muskit 61a19e3fe2 revise scripts 2024-04-20 12:28:22 -07:00
muskit d5d8db272f update run.sh 2024-04-20 01:41:54 -07:00
muskit 3d96e8532a update requirements_dev.txt 2024-04-20 01:41:42 -07:00
muskit 7fc86543e6 temporary patch for scraper lock outs 2024-04-20 01:41:27 -07:00
muskit bacc426a6d go back to passwords, use diff format 2024-04-19 23:30:28 -07:00
muskit 18dfb0a7c9 update tweety 2024-04-19 23:25:16 -07:00
muskit 1ca9fce722 move scripts into its own folder 2024-04-19 23:05:13 -07:00
muskit f1eace1f63 update scraper.py 2024-03-18 00:53:40 -07:00
muskit 608e712bce update scraper.py 2024-03-18 00:43:42 -07:00
muskit 805a1355fa update scraper.py 2024-03-18 00:42:47 -07:00
muskit 8f0825ec2e distinguish RateLimitReached from UnknownError 2024-03-18 00:21:51 -07:00
muskit f9a9e47f7d update scraper.py 2024-03-18 00:05:46 -07:00
muskit 3eded34c0f update scraper.py 2024-03-18 00:02:21 -07:00
muskit af7ce7150b docs: update README.md 2024-03-17 23:52:00 -07:00
muskit c88ddc749a try using auth tokens on scraper 2024-03-17 23:50:17 -07:00
muskit 95f654316b update tweety commit 2024-03-17 22:07:13 -07:00
muskit 0903c72230 update build.sh 2024-03-13 19:09:06 -07:00
muskit d8b82da5cb separate running and building 2024-03-13 19:05:21 -07:00
muskit a2f9185f8f Merge pull request #8 from muskit/cleanup
Cleanup
2024-03-08 15:34:26 -08:00
muskit ca3da14bd5 add dry run, handling of None names (#7) 2024-03-08 15:33:11 -08:00
muskit 058c2a1c32 see u later printer boy 2024-02-17 23:09:04 -08:00
muskit 9ef533eacb man 2024-02-17 01:17:34 -08:00
muskit 5636443581 shorten catchup interval 2024-02-10 01:25:30 -08:00
muskit f038233125 adapt scraping code to mainline library version 2024-02-08 14:33:16 -08:00
muskit 6d61814f00 add requirements list for dev 2024-02-08 14:05:32 -08:00
muskit 84e56d1ead why were there full-width spaces 2024-02-08 14:04:02 -08:00
muskit 400504d36e Merge branch 'main' into cleanup 2024-02-08 03:41:22 -08:00
muskit dc6015e287 Update Dockerfile
add cjk font package
2024-02-04 10:58:41 -08:00
muskit 8fda473316 docs: update README.md 2024-02-02 02:23:09 -08:00
muskit 6675165906 Merge branch 'main' into cleanup 2024-02-02 02:18:14 -08:00
muskit e0c547314d update Dockerfile and requirements.txt 2024-02-01 17:37:51 -08:00
muskit cd6c86243a Update Dockerfile 2024-02-01 15:16:33 -08:00
muskit 23e844244e Update Dockerfile 2024-02-01 15:11:44 -08:00
muskit 215019dac9 Update Dockerfile 2024-02-01 15:10:53 -08:00
muskit 1ec5ba338a Update Dockerfile to use alpine
goddamn ubuntu and their snap reqs
2024-02-01 15:09:54 -08:00