Skip to content

Derived Products

AALibrary has work products related to analysis. We call these "derived products". The ultimate goal with derived products is to store them in the cloud, in order to have everything cloud-based. We also wanted to sort derived products based on users, so each user has a folder in GCS that stores their derived products. Based on these restrictions, we have achieved the following directory structure:

Directory Structure

derived-product-folder-layout.png

There are utility functions associated with the derived products in AALibrary. These can be found in the derived.py file. These functions include things such as get_all_derived_products_for_current_user() and upload_derived_product_to_gcp().

There is metadata associated with each derived product, and it is stored in BigQuery under the metadata.aalibrary_derived_file_metadata table.