Commits · cf3598d798ad4cd65177bb4cd77f49248e0b208c · Adam Viktora / crawler_module

Nov 07, 2022
- key error repaired · cf3598d7
  Adam Viktora authored Nov 07, 2022
  
  cf3598d7
- catching when invalid session id exception occurs - creating new webdriver instance in that case · a11368a5
  Adam Viktora authored Nov 07, 2022
  
  a11368a5
- documentation · 11b86fbe
  Adam Viktora authored Nov 07, 2022
  
  11b86fbe
- justext not working correctly examples · 954caaf1
  Adam Viktora authored Nov 07, 2022
  
  954caaf1
- better strategy for evaluation of useful websites · da51aae1
  Adam Viktora authored Nov 07, 2022
  
  da51aae1
- better strategy for evaluation of useful websites · a8066a36
  Adam Viktora authored Nov 07, 2022
  
  a8066a36
- better number format in evaluator · a7f53333
  Adam Viktora authored Nov 07, 2022
  
  a7f53333
Nov 04, 2022
- extra_text_evaluator.py refactoring, more clear summary of evaluated data · fb3a337f
  Adam Viktora authored Nov 04, 2022
  
  fb3a337f
- python 3.8 unsupported typing changed · 71e531bd
  Adam Viktora authored Nov 04, 2022
  
  71e531bd
- thread count settable from command line · 856b5305
  Adam Viktora authored Nov 04, 2022
  
  856b5305
- web examples · 78dd71cd
  Adam Viktora authored Nov 04, 2022
  
  78dd71cd
- refactoring · e1ad82a6
  Adam Viktora authored Nov 04, 2022
  
  e1ad82a6
Nov 03, 2022
- refactoring · 1af39b77
  Adam Viktora authored Nov 03, 2022
  
  1af39b77
Nov 01, 2022
- waiting for AJAX (XMLHttpRequest) to finish, when website uses jQuery · b30f7981
  Adam Viktora authored Nov 01, 2022
  
  b30f7981
Oct 13, 2022
- better parallelization · 48608647
  Adam Viktora authored Oct 13, 2022
  
  48608647
- commiting before data_texter.py thread changes · a1f83fff
  Adam Viktora authored Oct 13, 2022
  
  a1f83fff
Oct 10, 2022
- presentation · 94dd56b5
  Adam Viktora authored Oct 10, 2022
  
  94dd56b5
- strategy for implementation to Spiderling · 197604ad
  Adam Viktora authored Oct 10, 2022
  
  197604ad
Oct 07, 2022
- more web examples · e5752356
  Adam Viktora authored Oct 07, 2022
  
  e5752356
Oct 06, 2022
- web example · 0285ecd6
  Adam Viktora authored Oct 06, 2022
  
  0285ecd6
- Merge remote-tracking branch 'origin/main' · 03f1277c
  Adam Viktora authored Oct 06, 2022
  
  03f1277c
- better summarization of script usefulness · 29381f5d
  Adam Viktora authored Oct 06, 2022
  
  29381f5d
- uploading test results · a8153d39
  Adam Viktora authored Oct 06, 2022
  
  a8153d39
Oct 05, 2022
- bad import repaired · 07304b68
  Adam Viktora authored Oct 05, 2022
  
  07304b68
- extra paragraphs only unique · f19f1a0b
  Adam Viktora authored Oct 05, 2022
  
  f19f1a0b
- cookies · 4cdaceb1
  Adam Viktora authored Oct 05, 2022
  
  4cdaceb1
- refactoring · a1a93a69
  Adam Viktora authored Oct 04, 2022
  
  a1a93a69
- cleaning file structure · 4e025bbd
  Adam Viktora authored Oct 04, 2022
  
  4e025bbd
- test results files · c5c0b8a4
  Adam Viktora authored Oct 05, 2022
  
  c5c0b8a4
Oct 03, 2022
- uploading test results · c950d94c
  Adam Viktora authored Oct 03, 2022
  
  c950d94c
- Added "extra_plaintext" parameter to webpage, evaluating quantity and quality... · ab212170
  Adam Viktora authored Oct 03, 2022
```
Added "extra_plaintext" parameter to webpage, evaluating quantity and quality of extra plaintext (removing paragraphs containing cookies, privacy policy, personalized ads, ...)
```
  ab212170
- custom USER AGENT · 76ed82cb
  Adam Viktora authored Oct 03, 2022
  
  76ed82cb
- cookie handling · 617db90e
  Adam Viktora authored Oct 03, 2022
  
  617db90e
- starting driver with service (download newest version) only once · b9b1ae77
  Adam Viktora authored Oct 03, 2022
  
  b9b1ae77
- javascript test html file · 1ec6ab55
  Adam Viktora authored Oct 03, 2022
  
  1ec6ab55
Sep 29, 2022
- List type · 43fdbe52
  Adam Viktora authored Sep 29, 2022
  
  43fdbe52
- bad import repaired · be00cd0e
  Adam Viktora authored Sep 29, 2022
  
  be00cd0e
- refactoring -- save detail info about webpage · 4bf504c8
  Adam Viktora authored Sep 29, 2022
  
  4bf504c8
- refactoring · a0d8a6f1
  Adam Viktora authored Sep 29, 2022
  
  a0d8a6f1
- refactoring · b630698e
  Adam Viktora authored Sep 29, 2022
  
  b630698e