Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Genovese-Felipe/Python-Data-Driven-Visualization-Journey

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

30 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

πŸ“Š Python Data Driven Visualization Journey

πŸ‡§πŸ‡· PortuguΓͺs | πŸ‡ΊπŸ‡Έ English

πŸ‡§πŸ‡· PortuguΓͺs (clique para expandir)

Nomes de Pastas e DescriΓ§Γ΅es (PT/EN):

  • dashboards/ β€” Dashboards interativos (Interactive dashboards)
  • docs/ β€” DocumentaΓ§Γ£o e guias (Documentation and guides)
  • error_reports/ β€” RelatΓ³rios de erros e liΓ§Γ΅es aprendidas (Error reports and lessons learned)
  • ai_learning_guides/ β€” InstruΓ§Γ΅es para IA e aprendizado de mΓ‘quina (AI and ML learning guides)
  • assets/ β€” Imagens, screenshots e arquivos de referΓͺncia (Images, screenshots, reference files)
  • requirements.txt β€” DependΓͺncias do projeto (Project dependencies)
  • README.md β€” DocumentaΓ§Γ£o principal (Main documentation)

Python Dash Plotly ML Status Journey

Uma jornada completa do desenvolvimento de dashboards Plotly/Dash: desde visualizaΓ§Γ΅es simples atΓ© anΓ‘lises complexas com Machine Learning


🎯 Visão Geral

Este repositΓ³rio documenta a evoluΓ§Γ£o completa de um projeto de dashboards interativos, comeΓ§ando com um aplicativo Dash problemΓ‘tico e culminando em trΓͺs versΓ΅es funcionais progressivamente mais sofisticadas:

  • V1: Dashboard simples com grΓ‘fico Sunburst
  • V2: Dashboard de construΓ§Γ£o com filtros avanΓ§ados
  • V3: Dashboard complexo com ML, mapas e mΓΊltiplas visualizaΓ§Γ΅es

🎨 Inspiração Visual

O projeto foi guiado por referΓͺncias visuais profissionais que definiram nossos padrΓ΅es de qualidade:

Sunburst HierΓ‘rquico AnΓ‘lise CientΓ­fica Dashboard Comercial
Ref1 Ref2 Ref3
Estrutura hierΓ‘rquica complexa CorrelaΓ§Γ£o e heatmap Vendas por categoria

πŸ“Š Dashboards Funcionais

🌟 V1 - Sunburst Simples

Porta: 8052 | Foco: Fundamentos

  • βœ… GrΓ‘fico Sunburst hierΓ‘rquico
  • βœ… Dados extraΓ­dos de HTML funcional
  • βœ… Interface limpa e responsiva
  • βœ… MΓ©tricas financeiras bΓ‘sicas

πŸ—οΈ V2 - ConstruΓ§Γ£o AvanΓ§ada

Porta: 8050 | Foco: Filtros & Interatividade

  • βœ… Filtros em cascata (Pillar β†’ Area β†’ Service)
  • βœ… Tooltips detalhados com variΓ’ncias
  • βœ… AnΓ‘lise de custos de construΓ§Γ£o
  • βœ… Interface profissional

🏑 V3 - Smart Home Complexo

Porta: 8053 | Foco: ML & AnΓ‘lise AvanΓ§ada

  • βœ… 4 VisualizaΓ§Γ΅es: Sunburst + Mapa + Scatter + ML
  • βœ… Machine Learning: AnΓ‘lise preditiva de economia de energia
  • βœ… Mapas GeogrΓ‘ficos: Coordenadas reais dos EUA
  • βœ… Design Moderno: Cards responsivos com styling avanΓ§ado

πŸš€ Quick Start

InstalaΓ§Γ£o

git clone https://github.com/Genovese-Felipe/Python-Data-Driven-Visualization-Journey.git
cd Python-Data-Driven-Visualization-Journey
pip install -r requirements.txt

Executar Dashboards

# V1 - Sunburst Simples
python dashboards/v1_simple/sunburst_cost_explorer_funcional.py
# Acesse: http://localhost:8052

# V2 - ConstruΓ§Γ£o AvanΓ§ada  
python dashboards/v2_construction/V2_script.py
# Acesse: http://localhost:8050

# V3 - Smart Home Complexo
python dashboards/v3_smart_home/Plan_V3_funcional.py
# Acesse: http://localhost:8053

πŸ“ Estrutura do Projeto

Python-Data-Driven-Visualization-Journey/
β”œβ”€β”€ πŸ“Š dashboards/
β”‚   β”œβ”€β”€ 🌟 v1_simple/           # Dashboard bΓ‘sico com Sunburst
β”‚   β”œβ”€β”€ πŸ—οΈ v2_construction/     # Dashboard de construΓ§Γ£o com filtros
β”‚   └── 🏑 v3_smart_home/       # Dashboard complexo com ML
β”œβ”€β”€ πŸ“š docs/                    # DocumentaΓ§Γ£o e guias
β”œβ”€β”€ πŸ”΄ error_reports/           # RelatΓ³rios de erros e liΓ§Γ΅es aprendidas
β”œβ”€β”€ πŸ€– ai_learning_guides/      # InstruΓ§Γ΅es para futuros modelos de IA
β”œβ”€β”€ 🎨 assets/                  # Arquivos de referΓͺncia e recursos
β”‚   β”œβ”€β”€ πŸ–ΌοΈ reference_images/    # Imagens que inspiraram o projeto
β”‚   β”œβ”€β”€ πŸ“Έ screenshots/         # Capturas de tela da evoluΓ§Γ£o
β”‚   └── πŸ“„ HTML files           # Arquivos funcionais para extraΓ§Γ£o de dados
β”œβ”€β”€ πŸ“‹ requirements.txt         # DependΓͺncias do projeto
└── πŸ“– README.md               # Este arquivo

πŸ› οΈ Tecnologias Utilizadas

Categoria Tecnologia VersΓ£o Uso
Backend Python 3.12+ Linguagem principal
Web Framework Dash 2.x AplicaΓ§Γ΅es web interativas
VisualizaΓ§Γ£o Plotly 5.x GrΓ‘ficos e visualizaΓ§Γ΅es
Machine Learning Scikit-Learn 1.x AnΓ‘lise preditiva
Data Processing Pandas 2.x ManipulaΓ§Γ£o de dados
Scientific Computing NumPy 1.x ComputaΓ§Γ£o numΓ©rica

πŸ“ˆ EvoluΓ§Γ£o do Projeto

Ponto de Partida: ReferΓͺncias Visuais 🎨

Baseamo-nos em referΓͺncias visuais profissionais para definir o padrΓ£o de qualidade:

ReferΓͺncias Exemplo de Sunburst hierΓ‘rquico complexo usado como inspiraΓ§Γ£o

Fase 1: Problema Inicial πŸ”₯

  • App Dash com mΓΊltiplos erros de callback
  • Estrutura hierΓ‘rquica mal construΓ­da
  • Interface nΓ£o responsiva
  • Status: ❌ NΓ£o funcional

Fase 2: AnΓ‘lise & CorreΓ§Γ£o πŸ”

  • AnΓ‘lise de arquivos HTML funcionais
  • ExtraΓ§Γ£o de dados estruturados
  • IdentificaΓ§Γ£o de padrΓ΅es funcionais
  • Status: πŸ”„ Em desenvolvimento

Fase 3: V1 - FundaΓ§Γ£o SΓ³lida βœ…

  • Dashboard simples e funcional
  • Dados reais extraΓ­dos de HTML
  • GrΓ‘fico Sunburst perfeitamente renderizado
  • Status: βœ… Funcional

Fase 4: V2 - Interatividade AvanΓ§ada πŸ—οΈ

  • Sistema de filtros em cascata
  • Tooltips informativos
  • AnΓ‘lise de variΓ’ncias de custos
  • Status: βœ… Funcional

Fase 5: V3 - Complexidade Total 🏑

  • 4 tipos de visualizaΓ§Γ£o integrados
  • Machine Learning para anΓ‘lise preditiva
  • Mapas geogrΓ‘ficos interativos
  • Status: βœ… Funcional

Resultado Final: TrΓͺs Dashboards Funcionais πŸŽ‰

Dashboard Evolution Screenshot dos trΓͺs dashboards rodando simultaneamente: V1 (Sunburst), V2 (Construction), V3 (Smart Home)


πŸŽ“ LiΓ§Γ΅es Aprendidas

βœ… O que Funcionou

  • AnΓ‘lise de cΓ³digo funcional existente
  • ExtraΓ§Γ£o de dados estruturados de HTML
  • Desenvolvimento incremental (V1 β†’ V2 β†’ V3)
  • Foco na funcionalidade antes da complexidade
  • Uso de referΓͺncias visuais profissionais
  • DocumentaΓ§Γ£o visual completa da jornada

❌ Erros Comuns Evitados

  • Callbacks complexos demais
  • Estruturas hierΓ‘rquicas mal planejadas
  • Tentativa de corrigir cΓ³digo quebrado vs. recriar
  • Falta de dados estruturados adequados
  • Desenvolvimento sem referΓͺncias visuais claras

πŸ“Έ DocumentaΓ§Γ£o Visual

Todo o processo foi documentado visualmente:


🀝 Contribuiçáes

Este projeto serve como:

  • Template para dashboards Plotly/Dash
  • Guia de boas prΓ‘ticas para visualizaΓ§Γ£o de dados
  • Exemplo de evoluΓ§Γ£o de projeto de dados
  • ReferΓͺncia de debugging para aplicaΓ§Γ΅es Dash

πŸ“ LicenΓ§a

Este projeto estΓ‘ licenciado sob a MIT License.


πŸ‘¨β€πŸ’» Autor

Felipe Genovese


πŸ“ž Suporte

Para dΓΊvidas, problemas ou sugestΓ΅es:

  1. Consulte a documentaΓ§Γ£o
  2. Verifique os relatΓ³rios de erro
  3. Abra uma Issue

πŸŽ‰ Projeto ConcluΓ­do com Sucesso! πŸŽ‰

De um app quebrado para trΓͺs dashboards funcionais com ML


πŸ‡ΊπŸ‡Έ English (click to expand)

Folder Names and Descriptions (EN/PT):

  • dashboards/ β€” Interactive dashboards (Dashboards interativos)
  • docs/ β€” Documentation and guides (DocumentaΓ§Γ£o e guias)
  • error_reports/ β€” Error reports and lessons learned (RelatΓ³rios de erros e liΓ§Γ΅es aprendidas)
  • ai_learning_guides/ β€” AI and ML learning guides (InstruΓ§Γ΅es para IA e aprendizado de mΓ‘quina)
  • assets/ β€” Images, screenshots, reference files (Imagens, screenshots, arquivos de referΓͺncia)
  • requirements.txt β€” Project dependencies (DependΓͺncias do projeto)
  • README.md β€” Main documentation (DocumentaΓ§Γ£o principal)

πŸ“Š Python Data Driven Visualization Journey

A complete journey in Plotly/Dash dashboard development: from simple visualizations to complex Machine Learning analytics


🎯 Overview

This repository documents the full evolution of an interactive dashboard project, starting from a problematic Dash app and culminating in three progressively more sophisticated functional versions:

  • V1: Simple dashboard with Sunburst chart
  • V2: Construction dashboard with advanced filters
  • V3: Complex dashboard with ML, maps, and multiple visualizations

🎨 Visual Inspiration

The project was guided by professional visual references that set our quality standards:

Hierarchical Sunburst Scientific Analysis Business Dashboard
Ref1 Ref2 Ref3
Complex hierarchical structure Correlation and heatmap Sales by category

πŸ“Š Functional Dashboards

🌟 V1 - Simple Sunburst

Port: 8052 | Focus: Fundamentals

  • βœ… Hierarchical Sunburst chart
  • βœ… Data extracted from functional HTML
  • βœ… Clean and responsive interface
  • βœ… Basic financial metrics

πŸ—οΈ V2 - Advanced Construction

Port: 8050 | Focus: Filters & Interactivity

  • βœ… Cascading filters (Pillar β†’ Area β†’ Service)
  • βœ… Detailed tooltips with variances
  • βœ… Construction cost analysis
  • βœ… Professional interface

🏑 V3 - Complex Smart Home

Port: 8053 | Focus: ML & Advanced Analytics

  • βœ… 4 Visualizations: Sunburst + Map + Scatter + ML
  • βœ… Machine Learning: Predictive energy savings analysis
  • βœ… Geographic Maps: Real US coordinates
  • βœ… Modern Design: Responsive cards with advanced styling

πŸš€ Quick Start

Installation

git clone https://github.com/Genovese-Felipe/Python-Data-Driven-Visualization-Journey.git
cd Python-Data-Driven-Visualization-Journey
pip install -r requirements.txt

Run Dashboards

# V1 - Simple Sunburst
python dashboards/v1_simple/sunburst_cost_explorer_funcional.py
# Access: http://localhost:8052

# V2 - Advanced Construction
python dashboards/v2_construction/V2_script.py
# Access: http://localhost:8050

# V3 - Complex Smart Home
python dashboards/v3_smart_home/Plan_V3_funcional.py
# Access: http://localhost:8053

πŸ“ Project Structure

Python-Data-Driven-Visualization-Journey/
β”œβ”€β”€ πŸ“Š dashboards/
β”‚   β”œβ”€β”€ 🌟 v1_simple/           # Basic Sunburst dashboard
β”‚   β”œβ”€β”€ πŸ—οΈ v2_construction/     # Construction dashboard with filters
β”‚   └── 🏑 v3_smart_home/       # Complex dashboard with ML
β”œβ”€β”€ πŸ“š docs/                    # Documentation and guides
β”œβ”€β”€ πŸ”΄ error_reports/           # Error reports and lessons learned
β”œβ”€β”€ πŸ€– ai_learning_guides/      # Instructions for future AI models
β”œβ”€β”€ 🎨 assets/                  # Reference files and resources
β”‚   β”œβ”€β”€ πŸ–ΌοΈ reference_images/    # Images that inspired the project
β”‚   β”œβ”€β”€ πŸ“Έ screenshots/         # Screenshots of the evolution
β”‚   └── πŸ“„ HTML files           # Functional files for data extraction
β”œβ”€β”€ πŸ“‹ requirements.txt         # Project dependencies
└── πŸ“– README.md               # This file

πŸ› οΈ Technologies Used

Category Technology Version Usage
Backend Python 3.12+ Main language
Web Framework Dash 2.x Interactive web apps
Visualization Plotly 5.x Charts and visualizations
Machine Learning Scikit-Learn 1.x Predictive analytics
Data Processing Pandas 2.x Data manipulation
Scientific Computing NumPy 1.x Numeric computation

πŸ“ˆ Project Evolution

Starting Point: Visual References 🎨

We based our standards on professional visual references:

References Example of a complex hierarchical Sunburst used as inspiration

Phase 1: Initial Problem πŸ”₯

  • Dash app with multiple callback errors
  • Poorly built hierarchical structure
  • Non-responsive interface
  • Status: ❌ Not functional

Phase 2: Analysis & Fixes πŸ”

  • Analysis of functional HTML files
  • Extraction of structured data
  • Identification of functional patterns
  • Status: πŸ”„ In development

Phase 3: V1 - Solid Foundation βœ…

  • Simple and functional dashboard
  • Real data extracted from HTML
  • Perfectly rendered Sunburst chart
  • Status: βœ… Functional

Phase 4: V2 - Advanced Interactivity πŸ—οΈ

  • Cascading filter system
  • Informative tooltips
  • Cost variance analysis
  • Status: βœ… Functional

Phase 5: V3 - Full Complexity 🏑

  • 4 integrated visualization types
  • Machine Learning for predictive analysis
  • Interactive geographic maps
  • Status: βœ… Functional

Final Result: Three Functional Dashboards πŸŽ‰

Dashboard Evolution Screenshot of the three dashboards running simultaneously: V1 (Sunburst), V2 (Construction), V3 (Smart Home)


πŸŽ“ Lessons Learned

βœ… What Worked

  • Analysis of existing functional code
  • Extraction of structured data from HTML
  • Incremental development (V1 β†’ V2 β†’ V3)
  • Focus on functionality before complexity
  • Use of professional visual references
  • Complete visual documentation of the journey

❌ Common Pitfalls Avoided

  • Overly complex callbacks
  • Poorly planned hierarchical structures
  • Trying to fix broken code vs. recreating
  • Lack of adequate structured data
  • Development without clear visual references

πŸ“Έ Visual Documentation

The entire process was visually documented:


🀝 Contributions

This project serves as:

  • Template for Plotly/Dash dashboards
  • Best practices guide for data visualization
  • Example of project evolution in data projects
  • Debugging reference for Dash applications

πŸ“ License

This project is licensed under the MIT License.


πŸ‘¨β€πŸ’» Author

Felipe Genovese


πŸ“ž Support

For questions, issues, or suggestions:

  1. Check the documentation
  2. See the error reports
  3. Open an Issue

πŸŽ‰ Project Successfully Completed! πŸŽ‰

From a broken app to three functional dashboards with ML

About

No description, website, or topics provided.

Resources

License

Contributing

Stars

Watchers

Forks

Packages

No packages published

Contributors 2

  •  
  •