aws - Russo.NYC

Sign in Subscribe

aws

A collection of 2 posts

EC2 - Scraping behind VPN (but allow VPC access)

I had a website scraping project that scraped tens of thousands of websites every day. I was running this on an EC2 instance, but didn't want the EC2 instance's IP to be blocked by any of these websites. One solution for scraping with (near) infinite IP's that I've come across

AWS Lambda "distribution was not found and is required" [Python]

AWS Lambda "distribution was not found and is required" [Python]

All of a sudden my most recent deploy hit the darnedest error and none of my endpoints were working... [ERROR] DistributionNotFound: The 'google-api-python-client' distribution was not found and is required by the application Traceback (most recent call last): File "/var/lang/lib/python3.7/imp.py", line 234, in load_