Commit Graph
109 Commits
Author SHA1 Message Date
yoshiko2 1604f0567f Optimize error output & adjust code sequence 2021-12-02 02:00:54 +08:00
Mathhew 0fcb11be35 Fix: raise exception in get html
catching exception won't work in methods, eg javbus
2021-11-25 09:26:15 +08:00
yoshiko2 1acf8b5096 Fix web request encoding #2 2021-11-23 22:13:35 +08:00
unknown fc933615f0 Fix web request encoding 2021-11-23 00:20:15 +08:00
yoshiko2 963320a14e Update translate func for title 2021-11-09 13:35:58 +08:00
Yoshiko2 e825ad99a3 Merge pull request #630 from lededev/storyline-3
storyline: still need improve
2021-11-06 23:20:58 +08:00
Yoshiko2 06297949da Merge branch 'master' into parallel-mapdown 2021-11-06 23:17:52 +08:00
unknown 0c4df0130b Delete large translate 2021-11-06 22:45:44 +08:00
lededev a9c4b0e417 parallel map download 2021-11-05 07:42:58 +08:00
lededev e8af0e5a53 Merge branch 'master' into storyline-3 2021-11-05 03:29:56 +08:00
lededev 92effe53b7 storyline: still need improve 2021-11-05 02:59:48 +08:00
yoshiko2 50c3975b75 Add Donwload Mapping Table function 2021-11-05 00:49:19 +08:00
lededev e564629f16 deal with websites behind Clo*dfl**e 2021-11-02 03:51:31 +08:00
lededev 3b498d32ca replace browser by session in some places 2021-11-01 03:49:35 +08:00
lededev 05a0838d86 UA update to chrome v95 2021-10-31 03:21:39 +08:00
lededev 921f926056 ADC_function.py: add browser retry and timeout 2021-10-23 05:21:08 +08:00
lededev c440315488 翻译前检查语言,已经是中文了不必翻译,只翻译日语 2021-10-20 23:07:37 +08:00
lededev cb83e4246d 无码检测移入number_parser.py并扩充识别能力 2021-10-20 03:34:44 +08:00
lededev 24b4f9f5e2 将元数据的来源网站记入日志以便进行评估 2021-10-18 10:51:32 +08:00
lededev a546c4e83e Parall query on storyline data 2021-10-17 21:59:08 +08:00
lededev 7f8d500b13 correction mechanicalsoup browser with cookies calling method 2021-10-15 21:00:32 +08:00
lededev 317449c568 try fix issue 616: onedrive OSError input/output 2021-10-15 09:11:40 +08:00
lededev f8dc05a38b improve javbus and javdb outline source 2021-10-12 11:28:17 +08:00
lededev 0933e87944 fix outline of javbus and javdb which caused by airav down 2021-10-10 17:41:33 +08:00
lededev 3873d1aa4c update user agent 2021-10-09 19:37:40 +08:00
lededev 8ab736e4fa AV_Data_Capture.py:command params new add -m -d -c -i -g -z 2021-10-08 13:02:52 +08:00
lededev 40d25d23f5 ADC_function.py:换装getInstance(),load_cookies()改用pathlib 2021-10-08 12:17:12 +08:00
lededev 531840c3fb 还有一点小bug,以及代码清理 2021-09-29 06:37:45 +08:00
Yoshiko2 256c711c6d Merge pull request #599 from lededev/ggt-conf
google translate site configurable
2021-09-28 13:58:08 +08:00
lededev 536ee3f6d8 google translate site configurable 2021-09-28 00:28:31 +08:00
lededev b1d302a042 log fullpath 2021-09-28 00:26:01 +08:00
lededev 75b71888d9 javdb*.json path search order 2021-09-27 22:20:37 +08:00
Yoshiko2 30bc6a59c6 Merge pull request #591 from lededev/xcity-f1
xcity.py: get detail page by form query
2021-09-27 22:00:43 +08:00
lededev 16078b95b1 解决一个视频文件名不带,而.nfo文件名带'-流出'的死循环bug 2021-09-26 00:35:00 +08:00
lededev 0ca57fa8c1 add Google-free translate failed warnning 2021-09-25 19:31:53 +08:00
lededev c7b83bfc0e update user agent 2021-09-23 22:20:25 +08:00
lededev 50574a705b carib.py: add outline/series/actor_photo 2021-09-23 15:45:00 +08:00
lededev 54ed626294 remove abs_url(), just urljoin() is enough 2021-09-23 08:21:01 +08:00
lededev 367d53b09b add param allow return stateful browser for follow_link() 2021-09-23 05:10:43 +08:00
lededev d6677b717d check add cookies 2021-09-23 03:56:55 +08:00
lededev b59b4938d6 xcity.py: get detail page by form query 2021-09-22 06:03:58 +08:00
Mathhew 2c41487a4e Move get_data_from_json to WebCrawler 2021-07-28 16:12:08 +08:00
tojito 9ed239105a add fc2club 2021-07-19 01:04:50 +08:00
lededev 3cce315100 convert image relative url to absolute url 2021-06-11 13:53:08 +08:00
lededev 36c734ca9e upgrade User-Agent string to current Chrome version 2021-06-06 05:57:22 +08:00
lededev 9f1e6d5206 video files must be regular files, links will be ignored 2021-06-05 21:00:35 +08:00
Mathhew 7fe5b69ad2 Refine Proxy 2021-06-04 13:43:55 +08:00
lededev 8908bb8892 javdb: fix title, cookie expiration detection 2021-05-20 21:25:17 +08:00
lededev 3042001df5 javdb enable user login cookies 2021-05-09 12:23:21 +08:00
lededev 10e35cbd92 fix carib and 1pond number issues 2021-05-05 12:00:10 +08:00