QuickSight Data Visualization Project

Project Overview

This project demonstrates the effective use of Amazon QuickSight for data analysis and visualization. Using a Netflix dataset as an example, I created interactive dashboards that transformed raw data into actionable insights.

While this specific project analyzed entertainment content, the same techniques can be applied to security log analysis, threat detection patterns, and compliance reporting in cybersecurity contexts.

Key Technologies

AWS QuickSight - Cloud-native business intelligence service
AWS S3 - Object storage for dataset and manifest files
Data Transformation - Preparing data for analysis
Interactive Dashboards - Filters, charts and visualizations

1 Data Preparation and Storage

I began by creating an S3 bucket to store the Netflix dataset (netflix_titles.csv) and a manifest.json file that defines the dataset structure. The manifest file is crucial as it tells QuickSight how to interpret the data fields and relationships.

Security Application: This step would involve storing security logs, threat intelligence feeds, or compliance data in a structured format for analysis.

2 QuickSight Configuration

After setting up a QuickSight account with a 30-day free trial, I connected it to the S3 bucket containing the dataset. This required configuring proper IAM permissions to allow QuickSight to access the S3 data.

Security Application: In security scenarios, this would involve connecting QuickSight to security logs from services like CloudTrail, VPC Flow Logs, or GuardDuty findings.

3 Creating Visualizations

I created multiple visualizations to analyze different aspects of the Netflix catalog, including:

A distribution of content by release year
Content categorization by type (Movies vs. TV Shows)
Genre analysis with filtering capabilities

Security Application: For security data, similar visualizations could track security incidents over time, categorize threats by severity, or identify patterns in attack vectors.

4 Implementing Interactive Elements

I enhanced the dashboard with interactive filters that allow users to dynamically adjust the data being displayed. This included filtering by date range (2015 onward) and by specific content categories like action/adventure, TV comedies, and thrillers.

Security Application: In security applications, this would enable analysts to filter security events by time periods, severity levels, or affected resources to quickly identify patterns or anomalies.

5 Data Refresh and Maintenance

I implemented a data refresh process to update the analysis with new information. This involved uploading an updated dataset to S3, modifying the manifest file to reference the new data, and triggering a refresh in QuickSight.

Security Application: For security operations, this process would ensure that dashboards display the most current security information, enabling real-time monitoring and response.

Security Applications

While this project used entertainment data for demonstration, the same AWS QuickSight techniques can be applied to security operations:

Security Log Analysis

Visualize patterns in authentication attempts, access denials, or suspicious activities to identify potential security incidents before they escalate.

Compliance Reporting

Create dashboards showing compliance status across different resources and requirements, making it easier to identify gaps and prioritize remediation efforts.

Threat Intelligence

Analyze and display threat data from multiple sources to identify emerging risks and correlate them with internal activities and vulnerabilities.

Resource Security Posture

Visualize security configurations and vulnerabilities across cloud resources to maintain consistent security standards and identify outliers.

Challenges and Solutions

Understanding Manifest Files

Challenge: The most difficult aspect was understanding how the manifest.json file works and how it interacts with QuickSight.

Solution: I researched the manifest file structure in AWS documentation and experimented with different configurations until I understood the correct syntax for defining data sources.

Data Quality Issues

Challenge: The initial dataset contained incomplete information, particularly missing country data, which affected analysis quality.

Solution: I obtained a more complete dataset, uploaded it to S3, updated the manifest file to point to the new data, and performed a full refresh in QuickSight.

Key Takeaways

This project provided valuable insights into data visualization and analytics in the AWS ecosystem:

QuickSight provides powerful visualization capabilities without requiring extensive coding
Proper data preparation is essential for creating meaningful visualizations
Interactive elements like filters dramatically enhance the utility of dashboards
The process of refreshing data ensures that analyses remain relevant and accurate
These skills are directly transferable to security monitoring and analysis use cases

← Return to Portfolio

Jose Felix Cruz

Visualize Data with AWS QuickSight