On-premise AI in a segregated network
Deutsche Telekom AG – Telekom Security – Berlin. Classified information network under VS-NfD.
Problem: AI tools and models are required but must not leave the segregated environment.
Approach: Planned the AI workload hardware (HP ProLiant Gen10), built and integrated on-premise LLM servers under VS-NfD operating rules, assessed and rolled out an adoption strategy for AI tools against BSI and data protection requirements, prompt engineering and Python-based tool integration.
Result: Model operations inside the own network without cloud dependency, documented adoption strategy, Python-based tool integration in production. Additionally an ELK stack SIEM with AI-assisted anomaly detection and automatic ticket creation in Jira.