Skip to content

NitinKumar004/bi_directional_tool

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

2 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸš€ Data Ingestion Tool – ClickHouse & CSV Integration

A powerful, user-friendly web tool to facilitate bidirectional data transfer between ClickHouse databases and CSV flat files. Designed with scalability and simplicity in mind, this tool is ideal for developers, analysts, and data engineers who need quick and efficient data migration or export.


πŸ“Œ Features

  • πŸ”„ ClickHouse β†’ CSV Export
  • πŸ“₯ CSV β†’ ClickHouse Import
  • βœ… Column selection before ingestion
  • ⚑ Stream-based large dataset handling
  • πŸ” JWT/password authentication for ClickHouse
  • πŸŽ›οΈ User-friendly, step-by-step UI workflow

πŸ› οΈ Technologies Used

Layer Tech Stack
Frontend React, Axios, CSS
Backend Node.js, Express, Multer
Database ClickHouse
Parsing csv-parser (Node.js stream-based)
ClickHouse Client @clickhouse/client

πŸ“‚ Project Structure

β”œβ”€β”€ client/                 # React frontend
β”‚   β”œβ”€β”€ components/
β”‚   β”œβ”€β”€ App.js
β”‚   └── ...
β”œβ”€β”€ server/                 # Node.js backend
β”‚   β”œβ”€β”€ routes/
β”‚   β”œβ”€β”€ controllers/
β”‚   └── server.js
β”œβ”€β”€ uploads/               # Uploaded CSV files
β”œβ”€β”€ README.md
└── package.json

About

No description, website, or topics provided.

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors