Arlington Public-Facing Staff Directory

ETL: AWS Lambda Python function

  1. Retrieve external API credentials from DynamoDB and decrypt with KMS (using CredStash)
  2. Download staff details from Office 365 SharePoint list
  3. Sync profile pictures from Outlook to S3, storing eTag as S3 metadata
  4. Generate JSON file for public website and mobile apps
  5. Upload JSON file to S3
  6. Generate CSV file for open data portal
  7. Upload CSV to open data portal

Leave a Reply

Your email address will not be published. Required fields are marked *