Skip to content

Integrate Python logging module into all .py files of Quantifying + README Update for Logging #97

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 40 commits into from
Apr 1, 2024
Merged
Changes from 1 commit
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
a7ba26d
Update README.md with Python Logging resource
naishasinha Mar 18, 2024
0eaa594
Integrate logging module into deviantart_scratcher.py
naishasinha Mar 18, 2024
32da947
Integrate logging module into data_analysis.py
naishasinha Mar 18, 2024
dba6b11
Integrate logging module into data_cleaning.py
naishasinha Mar 18, 2024
efc8c76
Integrate logging module into photos_detail.py
naishasinha Mar 18, 2024
c4d1140
Integrate logging module into photos.py
naishasinha Mar 18, 2024
ace1987
Integrate logging module into google_scratcher.py
naishasinha Mar 18, 2024
b69bc55
Integrate logging into internetarchive_scratcher.py
naishasinha Mar 18, 2024
e86c66e
Integrate logging module into metmuseum_scratcher.py
naishasinha Mar 18, 2024
085a3cd
Integrate logging module into vimeo_scratcher.py
naishasinha Mar 18, 2024
bfb3ce9
Integrate logging module into wikicommons_scratcher.py
naishasinha Mar 18, 2024
2b28549
Integrate logging module into wikipedia_scratcher.py
naishasinha Mar 18, 2024
093b281
Integrate logging module into youtube_scratcher.py
naishasinha Mar 18, 2024
07dcb28
Update deviantart_scratcher.py with correct logging statement
naishasinha Mar 20, 2024
e0e16d4
Update data_cleaning.py with correct logging statement
naishasinha Mar 20, 2024
eb966af
Update photos.py with correct logging statement
naishasinha Mar 20, 2024
55f597a
Update photos_detail.py with correct logging statement
naishasinha Mar 20, 2024
794db36
Update data_analysis.py with correct logging statements
naishasinha Mar 20, 2024
46582f1
Update deviantart_scratcher.py with correct logging
naishasinha Mar 21, 2024
d54fe4a
Update data_cleaning.py with correct logging
naishasinha Mar 21, 2024
4966b31
Update photos.py with correct logging
naishasinha Mar 21, 2024
b5cb64f
Update photos_detail.py with correct logging
naishasinha Mar 21, 2024
29dc272
Update google_scratcher.py with correct logging
naishasinha Mar 21, 2024
361e684
Update internetarchive_scratcher.py with correct logging
naishasinha Mar 21, 2024
834f3a4
Update metmuseum_scratcher.py with correct logging
naishasinha Mar 21, 2024
2f07873
Update vimeo_scratcher.py with correct logging
naishasinha Mar 21, 2024
788190c
Update wikicommons_scratcher.py with correct logging statements
naishasinha Mar 21, 2024
eb1853f
Update wikipedia_scratcher.py with correct logging statements
naishasinha Mar 21, 2024
8c099ec
Update youtube_scratcher.py with correct logging statements
naishasinha Mar 21, 2024
3b0d668
Merge branch 'main' into main
TimidRobot Mar 26, 2024
d25b2b4
Updated deviantart_scratcher.py with f-string
naishasinha Mar 26, 2024
79d29e5
Imported traceback to all files, fixing 'undefined traceback' error. …
naishasinha Mar 30, 2024
739068a
Resolve merge conflicts
naishasinha Mar 30, 2024
c70e000
Merge branch 'main' into main
naishasinha Mar 30, 2024
14536f8
Update deviantart_scratcher.py with removed datetime import
naishasinha Apr 1, 2024
cdcb8db
Update metmuseum_scratcher.py - removed datetime import
naishasinha Apr 1, 2024
42f9d3c
Update vimeo_scratcher.py - removed datetime import
naishasinha Apr 1, 2024
9467718
Update wikicommons_scratcher.py - removed datetime import
naishasinha Apr 1, 2024
29bd439
Update youtube_scratcher.py - removed datetime import
naishasinha Apr 1, 2024
2d58fb2
Fixed pre-commit whitespace issues
naishasinha Apr 1, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' into main
  • Loading branch information
TimidRobot authored Mar 26, 2024
commit 3b0d668b0894a7025c3185ff869d6aa824db00d6
19 changes: 14 additions & 5 deletions wikipedia/wikipedia_scratcher.py
Original file line number Diff line number Diff line change
Expand Up @@ -112,11 +112,20 @@ def get_response_elems(language="en"):
"an available Wikipedia client. Will therefore return an empty"
"dictionary for result, but will continue querying.")
return {}
elif "query" not in search_data:
LOG.exception(f"search data is: \n{search_data}")
sys.exit(1)
else:
raise e

search_data_dict = search_data["query"]["statistics"]
search_data_dict["language"] = language
return search_data_dict

except requests.HTTPError as e:
LOG.exception(f"HTTP Error: {e}")
raise
except requests.RequestException as e:
LOG.exception(f"Request Exception: {e}")
raise
except KeyError as e:
LOG.exception(f"KeyError: {e}. Search data is: {search_data}",)
raise


def set_up_data_file():
Expand Down
Loading
You are viewing a condensed version of this merge commit. You can view the full changes here.