Data Science From Scratch To Production MVP Style: Deploy To AWS Lambda

Push Pipeline and Model To AWS S3 Create Buckets AWS S3 is a wonderful managed service that lets us upload files and access them later. We’ll leverage this by uploading our pickled files so our API can fetch them later. First we’ll create two “buckets”, think of these like a folder, one for our pipelines and one for our models. import boto3 session = boto3.Session(profile_name="personal") s3 = session.client("s3") s3.create_bucket(Bucket="data-science-from-scratch-pipeline") s3.create_bucket(Bucket="data-science-from-scratch-model") If you get any errors like:...

April 11, 2020 · 6 min · Greg Hilston

Data Science From Scratch To Production MVP Style: API

Serializing If you’re not familiar with serialization and deserialization, “serialization” is the basic concept is taking an object in memory and converting it into a state that can be written to a file or sent over the network. While “deserialization” is the act of reversing that process to turn the file back into a object that can be used in code again. We’re leverage this so we can package up our model in a way that can be deployed along side our API and not married to it, allowing us to separate the notion of the API and the model....

April 10, 2020 · 2 min · Greg Hilston