About IYS
Galaksiya provided consultancy for a large-scale data management process for its client, İleti Yönetim Sistem A.Ş. (İYS). IYS was established by the Union of Chambers and Commodity Exchanges of Turkey to provide services for the purpose of establishing a national platform where commercial electronic message permissions and complaint processes can be managed.
Project Scope and Objectives
The Ministry of Trade of the Republic of Turkey has assigned the Union of Chambers and Commodity Exchanges of Turkey to establish a national platform where commercial electronic message permissions and complaint processes can be managed within the scope of Law No. 6563 on the Regulation of Electronic Commerce and related legislation. For this reason, the company aimed to develop a new platform to ensure that citizens' data is collected and managed within its organization, as required by law.
Challenges
The development of a commercial electronic message management platform, İYS, entailed overcoming significant challenges, foremost among them the complexities of handling vast volumes of data. The system required a highly scalable and resilient architecture to accommodate an ever-growing influx of data and a diverse user base and consent data, including citizens, service providers, and other stakeholders. Simultaneously, it was imperative to guarantee zero data loss while upholding strict data consistency. Furthermore, given the sensitivity of personal information, the implementation of stringent security protocols and rigorous compliance with regulatory standards was paramount.
Implemented Solution
A distributed architecture was meticulously designed and implemented to meet the scalability and high availability demands of the Message Management System. To facilitate seamless user account management by the İYS company, robust security mechanisms were established, leveraging open-source Keycloak for identity and access management (IAM). This solution was tightly integrated with the ERP system, ensuring a streamlined authentication and authorization workflow. Additionally, the e-Devlet identity provider was incorporated into Keycloak, enabling secure and compliant login integration with the İYS platform.
For high-speed search, real-time analytics, and centralized data storage, Elasticsearch—a distributed, document-based search and analysis engine at the core of the Elastic Stack—was deployed, offering a scalable and efficient data retrieval mechanism. Additionally, Kibana was employed for log tracking, system monitoring, and performance evaluation, ensuring comprehensive observability of the platform.
Given the high volume of traffic and intensive query loads, ensuring efficient data distribution was paramount. To achieve this, Apache Pulsar, a distributed messaging and streaming platform, was implemented, optimizing data flow and guaranteeing fault tolerance, high availability, and zero data loss through its durability mechanisms. Despite all the precautions implemented within the system, data inconsistencies were addressed through synchronization mechanisms facilitated by Apache NiFi, an open-source data integration and flow management platform. Furthermore, Prometheus, an open-source monitoring and alerting system, was utilized to enable robust metric collection and real-time alerting, while Grafana, an open-source analytics and visualization platform, was employed to visualize key performance metrics effectively.
To securely store and query personal data, Hardware Security Modules (HSMs)—specialized cryptographic devices designed for key protection, encryption, decryption, authentication, and digital signing—were integrated. Additionally, commercial electronic consent records were timestamped and stored, allowing verification through an electronic certificate service provider using digital signatures to authenticate their recording time within the İYS system.
A distributed relational database solution was implemented to ensure operator data, generated within the İYS data center, could be stored redundantly across multiple geographically distributed data centers, ensuring fault tolerance, high availability, and seamless access for operators.
Furthermore, the VIA API, developed as an extension of the İYS platform, by using subscription packages provided by IYS to service providers, facilitates seamless integration of citizens' permit approval and rejection workflows into their applications. Approvals can be obtained swiftly and securely by dispatching confirmation messages containing short links or OTP codes to recipients’ registered contact information. In addition, the system empowers citizens to easily submit rejection notifications via a simple text message (SMS) mechanism.
Success Metrics
The İYS platform has simplified the process for citizens to manage and track their commercial electronic messages. The platform's robust infrastructure and high accessibility ensure that it is used efficiently by a wide user base. On peak days, the system processed approximately 3 to 4 million consent transactions per day. Such workloads were managed by automating the scaling of resources up or down with Kubernetes. Various system errors and data inconsistencies are resolved quickly and effectively, customer relations are strengthened, and overall service reliability is increased.
Data consistency was handled successfully. After verifying the consistency of our tests, also confirmed the client's responses.
Added Value
The new platform enabled citizens, service providers, and business partners to efficiently monitor and manage their messages from a unified interface.
Overall Evaluation
This successful project turned into a long-term collaboration between Galaksiya and İleti Yönetim Sistemi A.Ş.