Exploring Databases, AI, and the Future of Tech
AWS Aurora MySQL doesn’t allow us to take backup of individual tables or database other than doing a regular mysqldump which can be difficult to restore. The option is to take a backup of the entire database instance. Restoring an individual or a set of tables can be a cumbersome process. I wrote a quick python … Read more
Lets upload the docker image you build locally to docker hub so you or others can pull it at a later time to use. I am assuming you already have a login to docker hub. If not please create an account. Its free !! From a command prompt type: docker images This will list out … Read more
Below are the steps for creating docker image for running a Jupyter Notebook with the latest python module . You can run this for any operating systems that supports docker. If you haven’t downloaded the docker desktop. Please do so from here Creating a Docker image with Jupyter Notebook and Python involves several steps, including … Read more
This example assumes you have a bastion server setup that will allow connection to follow thru to an existing MySQL server. The python code is run on an EC2 server that has security group setup on the bastion server to allow connections from the EC2 server. We need the following info: On the EC2 server … Read more
I normally start a cluster from the UI and decided I post how to create a cluster from the CLI. This is assuming the AWS CLI is installed and configured on your machine. The command you want to use is aws emr create-cluster. You will have to figure out what release of emr do you … Read more
This will show you how to copy objects between S3 buckets across different AWS Accounts. Its not an easy drag and drop. Not sure why Amazon doesn’t provide an easy “SFTP” like feature. Here are the steps: Prerequisites You would need access to both the AWS accounts You need IAM user access on the destination … Read more