Skip to content

Latest commit

Β 

History

History
373 lines (283 loc) Β· 12.8 KB

File metadata and controls

373 lines (283 loc) Β· 12.8 KB

Intelligent Knowledge Graph Construction System - Web Interface Features Guide

🌐 System Overview

This system provides a comprehensive web-based visualization interface that supports the complete workflow from knowledge graph construction to high-quality QA generation. It features modern frontend design with integrated real-time charts, interactive graph visualization, and intelligent data management capabilities.

πŸ“± Page Navigation & Features

🏠 Main Navigation Page (/)

Template File: templates/navigation.html

Core Features:

  • 🎯 Modern Card-Style Navigation - Intuitive functional module selection interface
  • πŸ“Š Quick Status Overview - System status and recent activity display
  • πŸš€ One-Click Access - Quick access to all functional modules
  • πŸ“± Responsive Design - Compatible with desktop and mobile devices

Use Cases: System entry point, feature overview, and quick navigation


πŸ”¬ Single QA Testing Page (/single-qa)

Template File: templates/single_qa.html

Core Features:

  • πŸ“ Entity Input Module

    • Smart input field supporting entity names (e.g., "diabetes", "artificial intelligence")
    • Real-time input validation and suggestions
  • βš™οΈ Parameter Control Panel

    • Maximum nodes setting (recommended 100-400)
    • Iteration count control (recommended 5-15)
    • Sampling strategy selection (5 algorithms: mixed, max_chain, etc.)
  • πŸ“ˆ Real-time Visualization Module

    • Left-side D3.js force-directed graph showing real-time graph construction
    • Dynamic rendering of nodes and connections
    • Interactive graph operations (zoom, drag, node click)
  • πŸ“‹ Detailed Log Stream

    • Right-side real-time log display with WebSocket updates
    • Construction step tracking and error monitoring
    • Trace ID support for issue diagnosis
  • 🎯 QA Results Display

    • Generated question-answer pairs after construction completion
    • Answer quality analysis and metadata information

Use Cases: Single entity deep analysis, algorithm testing, parameter tuning validation


πŸš€ Batch Generation Page (/batch-generation)

Template File: templates/batch_generation.html

Core Features:

  • πŸ“‚ Multiple Data Source Support

    • ✏️ Manual Input - Bulk entity input via text box with line separation
    • πŸ“ File Upload - Multiple format support: .txt, .csv, .json, .jsonl
  • βš™οΈ Batch Configuration Panel

    • Generation quantity control (supports 1-1000 entities)
    • Sampling parameter settings (nodes, iterations, algorithm selection)
    • Quality level settings (fast/standard/high-quality modes)
    • QPS limits and concurrency control
  • πŸ“Š Real-time Monitoring Dashboard

    • Current processing entity display
    • Overall progress bar and percentage
    • Success rate statistics and failure records
    • Estimated completion time (ETA)
  • πŸ’Ύ Results Management Module

    • Real-time preview of generated results
    • One-click JSONL format download
    • Save to evaluation dataset functionality
    • Failed task retry mechanism

Use Cases: Large-scale QA dataset generation, educational training data preparation, enterprise knowledge base construction


πŸ“Š Data Evaluation Page (/data-evaluation)

Template File: templates/data_evaluation.html

Core Features:

  • πŸ” Intelligent Evaluation Engine

    • 🧠 DeepSeek R1 Model - High-quality answer generation based on latest reasoning model
    • βš–οΈ Smart Comparison - Automatic comparison between standard and predicted answers
    • πŸ“Š Multi-dimensional Assessment - Accuracy, similarity, language quality, logical consistency
  • πŸ“ˆ Evaluation Dimension Analysis

    • Answer accuracy statistics
    • Semantic similarity calculation
    • Reasoning chain completeness check
    • Knowledge coverage analysis
  • πŸ“Š Visualization Analysis Module

    • Chart.js interactive charts
    • Multi-dimensional radar charts
    • Time series trend analysis
    • Error type distribution statistics
  • πŸ’Ό Dataset Management

    • Upload evaluation datasets
    • Batch evaluation task management
    • Evaluation result download and export
    • Historical evaluation record queries

Use Cases: QA quality assessment, model performance analysis, dataset quality control


πŸ†š Comparison Evaluation Page (/comparison-evaluation)

Template File: templates/comparison_evaluation.html

Core Features:

  • πŸ”„ A/B Testing Framework

    • Parallel comparison of multiple datasets
    • Performance comparison across different models
    • Algorithm effectiveness comparative analysis
  • πŸ“Š Comparison Dimension Settings

    • Custom evaluation metrics
    • Weight allocation mechanisms
    • Statistical significance testing
  • πŸ“ˆ Visual Comparison Reports

    • Side-by-side comparison charts
    • Difference heatmaps
    • Performance improvement/degradation analysis
  • πŸ’Ύ Comparison History Management

    • Historical comparison record queries
    • Comparison result export
    • Report generation and sharing

Use Cases: Algorithm performance comparison, model upgrade validation, quality improvement analysis


πŸ—ƒοΈ Data Management Page (/data-management)

Template File: templates/data_management.html

Core Features:

  • πŸ“ Dataset Management Center

    • View, edit, and delete generated datasets
    • Multi-format support (JSONL, JSON, CSV)
    • Dataset merge and split functionality
  • πŸ” Smart Content Preview

    • Online QA content preview with pagination
    • Keyword search and filtering capabilities
    • Real-time data quality checking
  • πŸ“Š Quality Analysis Tools

    • Dataset statistics (question count, average length, etc.)
    • Quality distribution analysis and visualization
    • Anomaly detection and marking
  • πŸ”§ Data Preprocessing Tools

    • Language detection and classification
    • Information leakage detection
    • Entity replacement and anonymization
    • Duplicate data removal
  • πŸ“₯ Batch Operations

    • Batch format conversion
    • Multi-file merge processing
    • Bulk download and export

Use Cases: Data cleaning, quality control, format conversion, dataset maintenance


🏷️ Domain Tagging Page (/domain-tags)

Template File: templates/domain_tags.html

Core Features:

  • 🎯 Smart Auto-Tagging

    • AI automatic entity domain identification (medical, technology, culture, education, etc.)
    • LLM-based semantic understanding annotation
    • Batch annotation processing support
  • ✏️ Manual Correction Functions

    • Manual annotation and editing interface
    • Batch tag modification tools
    • Annotation history and rollback
  • πŸ“Š Statistical Analysis Module

    • Domain distribution statistical charts
    • Annotation quality analysis
    • Domain coverage assessment
  • 🏷️ Tag Management System

    • Predefined domain tag library (sports, academic, politics, entertainment, literature, culture, economics, technology, history, medical, etc.)
    • Custom tag creation
    • Tag hierarchy management

Use Cases: Dataset classification, domain specialization, content organization, knowledge categorization


πŸ“š Runs QA Generation Page (/runs-qa-generation)

Template File: templates/runs_qa_generation.html

Core Features:

  • πŸ“‚ Run Record Management

    • Historical construction run record viewing
    • Run status and metadata display
    • Failed task reprocessing
  • πŸ”„ Secondary QA Generation

    • Generate new QA based on existing graph data
    • Secondary application of different sampling strategies
    • QPS-controlled batch processing
  • πŸ“Š Performance Monitoring

    • Real-time generation progress tracking
    • Success rate and quality statistics
    • Resource usage monitoring
  • πŸ’Ύ Result Integration

    • Multi-run result merging
    • Incremental update support
    • Version management and rollback

Use Cases: Graph reuse, incremental generation, historical data utilization


🎯 Final Datasets Page (/final-datasets)

Template File: templates/final_datasets.html

Core Features:

  • πŸ“‹ Dataset Overview

    • Final production dataset management
    • Version control and tag management
    • Dataset metadata display
  • πŸ” Advanced Filtering

    • Multi-dimensional data filtering
    • Custom query conditions
    • Real-time search and filtering
  • πŸ“Š Quality Assurance

    • Unique ID management and validation
    • Duplicate data detection
    • Data integrity checking
  • πŸ“€ Production-Ready Export

    • Multi-format export support
    • Bulk download functionality
    • Deployment-ready data package generation

Use Cases: Production data management, official releases, quality review, version publishing


πŸ”§ Technical Features

πŸ“‘ Real-time Communication

  • WebSocket Support - All pages support real-time status updates
  • Progress Tracking - Real-time progress display for long-running tasks
  • Error Monitoring - Real-time error capture and user alerts

🎨 Modern UI

  • Responsive Design - Beautiful Bootstrap-based interface
  • Interactive Charts - Chart.js and D3.js visualization components
  • Intuitive Operations - Drag-and-drop, click, batch selection interactions

πŸ’Ύ Data Persistence

  • Auto-save - Automatic result saving to prevent data loss
  • Resume Capability - Support for interruption recovery of large tasks
  • Version Management - Version tracking for data changes

πŸ”’ Quality Assurance

  • Parameter Validation - Real-time input parameter validation
  • Error Handling - Comprehensive error capture and notification mechanisms
  • Log Tracking - Detailed operation logs and Trace support

🎯 Usage Recommendations

πŸš€ Quick Start Workflow

  1. Main Navigation β†’ Understand system capabilities
  2. Single QA Testing β†’ Familiarize with basic operations
  3. Batch Generation β†’ Process actual data
  4. Data Evaluation β†’ Validate result quality
  5. Data Management β†’ Organize and optimize data

πŸ’‘ Best Practices

  • Test First: Use single QA testing to validate parameter settings
  • Batch Processing: Process large datasets in batches
  • Quality Monitoring: Regularly use evaluation features to check data quality
  • Backup Important Data: Download and backup important data promptly
  • Parameter Tuning: Adjust generation parameters based on specific needs

πŸ”„ Typical Workflows

πŸŽ“ Educational Training Scenario

Entity Preparation β†’ Single QA Testing β†’ Batch Generation β†’ Quality Evaluation β†’ Final Export

πŸ”¬ Research Development Scenario

Literature Entities β†’ Parameter Tuning β†’ Large-scale Generation β†’ Comparative Analysis β†’ Publication

🏒 Enterprise Application Scenario

Domain Terms β†’ Custom Tagging β†’ Batch Processing β†’ Quality Control β†’ Production Deployment

βš™οΈ Performance Optimization

πŸš€ High-Speed Processing Mode

  • Increase parallel workers (recommended ≀5)
  • Higher QPS limits (note API restrictions)
  • Reduce max nodes and sample size
  • Optimize model selection in configuration

🎯 High-Quality Mode

  • Increase sample size (recommended 15-20)
  • Increase max nodes (recommended 250-400)
  • Use max_chain sampling algorithm
  • Increase max iterations

πŸ’° Cost-Optimized Mode

  • Single worker with low QPS
  • Smaller sample sizes
  • Efficient model selection
  • Batch processing scheduling

πŸ“Š Output Formats & Integration

πŸ“„ Supported Export Formats

  • JSONL - Standard question-answer pairs
  • JSON - Structured data with metadata
  • CSV - Tabular format for analysis
  • TXT - Plain text for simple use cases

πŸ”Œ API Integration

  • REST APIs - All page functions accessible via REST
  • WebSocket Events - Real-time status updates
  • Batch Processing - Asynchronous task management
  • Authentication - Secure access control

πŸ“ˆ Analytics & Reporting

  • Performance Metrics - Generation speed, success rates
  • Quality Metrics - Accuracy, consistency, coverage
  • Usage Statistics - User activity, resource utilization
  • Custom Reports - Configurable analysis dashboards

πŸ› οΈ Troubleshooting

❌ Common Issues

  • Connection Problems: Check WebSocket connectivity
  • Performance Issues: Adjust concurrency settings
  • Quality Problems: Review parameter configurations
  • Data Issues: Use validation and cleaning tools

πŸ“ž Support Resources

  • System Logs: Detailed logging with trace IDs
  • Error Messages: Clear error descriptions and solutions
  • Documentation: Comprehensive user guides
  • Community: User forums and knowledge base

πŸ“ž Technical Support: Check system logs or contact technical team for issues ⭐ Continuous Updates: System features are continuously optimized, check update notes regularly 🌟 Open Source: Contributions welcome - submit issues and pull requests!