Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. This means customers of all sizes and industries can use it to store and protect any amount of data for a range of use cases, such as websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics.
JSON is not a normal tabular data format. Unlike tabular data the structure of each piece of JSON is tailored to a specific purpose. For example a piece of JSON for a form about you and your pets would have a very different structure to a piece of JSON for a manufacturing dashboard. Machine learning models expect standard tabular data just as spreadsheets and charts do. In order to use JSON to train our models and make predictions we need to transform it into meaningful tables.
REFORM lets you access as tables in TensorFlow for training and prediction. Simply provide the details of the buckets, browse even the most complex data as if it were a file browser and pick what you're interested in. Then simply load the dataframe with Pandas.
You can also optionally download the file
file_name = tf.keras.utils.get_file("example", "https://reform.example.com/api/tables/3a4f239c-984f-43f5-ab84-86cead94f0c8/live/dataset")
REFORM magically transforms the latest data into a mathematically correct analytic ready table and feeds this into your models for training and prediction.
REFORM also supports use cases where data needs additional JOINs or GROUP BYs before being used for machine learning. REFORM will transform your data into tables in AWS Redshift, Google BigQuery, Snowflake, AWS Athena and MS SQL Server which support JOINs and GROUP BYs and can be used as data sources by TensorFlow.