Refactor project structure and enhance documentation

- Removed `ai_engine.py` file and migrated its functionalities to a modular `AI/` package.
- Added `pyproject.toml` for improved dependency management and build configuration.
- Updated `.gitignore` to exclude egg-info files.
- Revised `CONTRIBUTING.md` and `README.md` to reflect changes in installation instructions and usage.
- Enhanced GitHub Actions workflow to include development dependencies during installation.
- Introduced new modules for schema fetching, test execution, and report generation, improving overall organization and maintainability.

Author: Av7danger

.github/workflows/secnode-pentest.yml

@@ -15,7 +15,7 @@ jobs:
           python-version: '3.10'
 
       - name: Install dependencies
-        run: pip install -r requirements.txt
+        run: pip install -r requirements.txt && pip install -e .[dev]
 
       - name: Run tests
         run: pytest
@@ -32,11 +32,11 @@ jobs:
           python-version: '3.10'
 
       - name: Install SecNode
-        run: pip install -r requirements.txt
+        run: pip install -r requirements.txt && pip install -e .
 
       - name: Run SecNode Scan
         env:
           SECNODE_LLM: ${{ secrets.SECNODE_LLM }}
           OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
           ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
-        run: python3 secnodeapi.py --target https://staging-api.example.com/swagger.json
+        run: secnodeapi --target https://staging-api.example.com/swagger.json

.gitignore

@@ -15,6 +15,7 @@ __pycache__/
 .pytest_cache/
 .coverage
 htmlcov/
+*.egg-info/
 
 # macOS
 .DS_Store

CONTRIBUTING.md

@@ -26,6 +26,7 @@ Thank you for your interest in contributing to SecNode API! This guide will help
 3. **Install dependencies**
    ```bash
    pip install -r requirements.txt
+   pip install -e .[dev]
    ```
 
 4. **Configure your LLM provider**
@@ -41,7 +42,7 @@ Thank you for your interest in contributing to SecNode API! This guide will help
 
 5. **Run SecNode in development mode**
    ```bash
-   python3 secnodeapi.py --target https://api.example.com/swagger.json
+   secnodeapi --target https://api.example.com/swagger.json
    ```
 
 ##  Enhancing the AI Engine

README.md

@@ -49,13 +49,14 @@ cd secnodeapi
 python3 -m venv venv
 source venv/bin/activate
 pip install -r requirements.txt
+pip install -e .
 
 # Configure your AI provider
 export SECNODE_LLM="openai/gpt-4o"
 export OPENAI_API_KEY="your-api-key"
 
 # Run your first security assessment
-python3 secnodeapi.py --target https://api.your-app.com/swagger.yaml
+secnodeapi --target https://api.your-app.com/swagger.yaml
 ```
 
 > [!NOTE]
@@ -89,28 +90,28 @@ SecNode rigorously hunts for:
 ### Basic Usage
 ```bash
 # Scan an API using a remote Swagger JSON
-python3 secnodeapi.py --target http://vulnapi.your-app.com/swagger.json
+secnodeapi --target http://vulnapi.your-app.com/swagger.json
 
 # Scan an API using a local OpenAPI YAML file
-python3 secnodeapi.py --target ./docs/openapi.yaml
+secnodeapi --target ./docs/openapi.yaml
 ```
 
 ### Advanced Testing Scenarios
 ```bash
 # Authenticated Testing (using inline Bearer token)
-python3 secnodeapi.py --target https://api.your-app.com/docs \
+secnodeapi --target https://api.your-app.com/docs \
   --auth-header "Authorization: Bearer my-jwt-token"
 
 # Authenticated Testing (using a JSON auth file)
-python3 secnodeapi.py --target https://api.your-app.com/docs \
+secnodeapi --target https://api.your-app.com/docs \
   --auth-file ./config/auth.json
 
 # Proxy Traffic (e.g. send traffic through Burp Suite/ZAP for manual review)
-python3 secnodeapi.py --target https://api.your-app.com/docs \
+secnodeapi --target https://api.your-app.com/docs \
   --proxy http://127.0.0.1:8080
 
 # Control Concurrency (Scale execution speed)
-python3 secnodeapi.py --target https://api.your-app.com/docs \
+secnodeapi --target https://api.your-app.com/docs \
   --concurrency 10
 ```
 
@@ -135,14 +136,14 @@ jobs:
           python-version: '3.10'
 
       - name: Install SecNode
-        run: pip install -r requirements.txt
+        run: pip install -r requirements.txt && pip install -e .
 
       - name: Run SecNode Scan
         env:
           SECNODE_LLM: ${{ secrets.SECNODE_LLM }}
           OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
           ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
-        run: python3 secnodeapi.py --target https://staging-api.example.com/swagger.json
+        run: secnodeapi --target https://staging-api.example.com/swagger.json
 ```
 
 ### Configuration

ai_engine.py

@@ -0,0 +1,38 @@
+[build-system]
+requires = ["setuptools>=69", "wheel"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "secnodeapi"
+version = "0.1.0"
+description = "Autonomous, AI-augmented API penetration testing framework."
+readme = "README.md"
+requires-python = ">=3.9"
+dependencies = [
+  "httpx==0.27.0",
+  "pydantic==2.6.3",
+  "structlog==24.1.0",
+  "litellm==1.34.0",
+  "PyYAML==6.0.1",
+]
+
+[project.optional-dependencies]
+dev = [
+  "pytest==8.3.5",
+  "pytest-asyncio==0.25.3",
+]
+
+[project.scripts]
+secnodeapi = "secnodeapi.cli:entrypoint"
+
+[tool.setuptools]
+package-dir = {"" = "src"}
+
+[tool.setuptools.packages.find]
+where = ["src"]
+
+[tool.pytest.ini_options]
+testpaths = ["tests"]
+python_files = ["test_*.py"]
+asyncio_mode = "strict"
+asyncio_default_fixture_loop_scope = "function"

pyproject.toml

@@ -0,0 +1,5 @@
+"""
+SecNode API package.
+"""
+
+__all__ = []

pytest.ini

@@ -0,0 +1,5 @@
+from .cli import entrypoint
+
+
+if __name__ == "__main__":
+    entrypoint()