• David McAmis

AWS Data Lake Resources

Here is a list of resources I have put together for building Data Lakes on AWS. If you have one to add, leave a comment.


AWS Data Lake Solution

Automatically configures the core AWS services necessary to easily tag, search, share, transform, analyze, and govern specific subsets of data across a company or with other external users. The solution deploys a console that users can access to search and browse available data sets for their business needs. Source Code | Architecture Diagram | Implementation Guide

Data Lake Quick Starts

· Data lake foundation with Apache Zeppelin and AWS services

· Qubole on a data lake foundation built with AWS services

· Hybrid data lake with WANdisco Fusion

· Data lake with Talend Big Data Platform

· Informatica Data Lake Management with AWS services

AWS Glue Resources

About https://aws.amazon.com/glue/

Pricing https://aws.amazon.com/glue/pricing/

Documentation https://aws.amazon.com/documentation/glue/

FAQ’s https://aws.amazon.com/glue/faqs/

Developer Resources https://aws.amazon.com/glue/developer-resources/

Glue Samples https://github.com/aws-samples/aws-glue-samples

Developer Forums https://forums.aws.amazon.com/forum.jspa?forumID=262&start=0

Blog Posts https://aws.amazon.com/blogs/big-data/tag/aws-glue/

AWS Athena Resources

About https://aws.amazon.com/athena/

Pricing https://aws.amazon.com/athena/pricing/

Documentation https://aws.amazon.com/documentation/athena/

FAQ’s https://aws.amazon.com/athena/faqs/

DDL and SQL Reference https://docs.aws.amazon.com/athena/latest/ug/ddl-sql-reference.html

Blog Posts https://aws.amazon.com/blogs/big-data/tag/amazon-athena/

Athena JDBC Drivers https://docs.aws.amazon.com/athena/latest/ug/connect-with-jdbc.html

Athena ODBC Drivers https://docs.aws.amazon.com/athena/latest/ug/connect-with-odbc.html

Developer Forums https://forums.aws.amazon.com/forum.jspa?forumID=242&start=0

AWS QuickSight Resources

About https://aws.amazon.com/quicksight/

Editions & Pricing https://aws.amazon.com/quicksight/pricing/

Customer Stories https://aws.amazon.com/quicksight/#Customers

QuickSight Community https://answers.quicksight.aws.amazon.com/sn/index.html

Documentation https://docs.aws.amazon.com/quicksight/latest/user/welcome.html

Product Videos https://aws.amazon.com/quicksight/resource-library/product-videos/

FAQ’s https://aws.amazon.com/quicksight/resource-library/faqs/

Fact Sheets https://aws.amazon.com/quicksight/resource-library/fact-sheets/

Blog Posts https://aws.amazon.com/blogs/big-data/tag/amazon-athena/

Developer Forums https://forums.aws.amazon.com/forum.jspa?forumID=246

Amazon Redshift Resources

About https://aws.amazon.com/redshift/

Pricing https://aws.amazon.com/redshift/pricing/

Customer Stories https://aws.amazon.com/redshift/customer-success/

Redshift Spectrum https://docs.aws.amazon.com/redshift/latest/dg/c-getting-started-using-spectrum.html

Documentation https://aws.amazon.com/redshift/resources/

FAQ’s https://aws.amazon.com/redshift/faqs/

Blog Posts https://aws.amazon.com/redshift/blog-posts/

Developer Forums https://forums.aws.amazon.com/forum.jspa?forumID=155

AWS Database Migration Service + Schema Conversion Tool

About https://aws.amazon.com/dms/

Pricing https://aws.amazon.com/dms/pricing/

Schema Conversion Tool https://aws.amazon.com/dms/#sct

Documentation http://docs.aws.amazon.com/dms/latest/userguide

FAQ’s https://aws.amazon.com/dms/faqs/

Step by Step Walk Throughs http://docs.aws.amazon.com/dms/latest/sbs/DMS-SBS-Welcome.html

Developer Forums https://forums.aws.amazon.com/forum.jspa?forumID=216



© 2020 by David McAmis