[go: up one dir, main page]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

If no people were found on face book page and we abort scraping, delete the saved page file #28

Open
ErikBoesen opened this issue Feb 16, 2021 · 0 comments
Open

If no people were found on face book page and we abort scraping, delete the saved page file #28

ErikBoesen opened this issue Feb 16, 2021 · 0 comments
Labels
scraper

Comments

@ErikBoesen
Copy link
Collaborator
ErikBoesen commented Feb 16, 2021 •
edited
Loading

This failure is caused when authentication has failed. Currently, if we change the passed token so that it's valid, and then immediately rerun the scraper, it'll use the existing page.html file from when the request failed, and the problem won't be fixed until we restart the heroku dyno (which resets the ephemeral filesystem).

Add code to the failing case to delete the page.html file.
@ErikBoesen ErikBoesen changed the title If no people were found on page and we abort scraping, delete the saved page file If no people were found on face book page and we abort scraping, delete the saved page file Feb 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
scraper
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ErikBoesen