Next Article in Journal
Language-Model-Based Architecture for Automatic Concept Placement in Ontologies
Previous Article in Journal
Anti-Jamming Drone Communication Using Wavelet and Adaptive Filter with Bidirectional Long Short-Term Memory
Previous Article in Special Issue
Explainable AI-Based Intrusion Detection Systems for Industry 5.0 and Adversarial XAI: A Systematic Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

SocioTable-KZ: Ethical and Privacy-Aware Bilingual Generation from Sociological Survey Data

Department of Artificial Intelligence and Big Data, Faculty of Information Technology and Artificial Intelligence, Al-Farabi Kazakh National University, Almaty 050040, Kazakhstan
*
Author to whom correspondence should be addressed.
Information 2026, 17(8), 765; https://doi.org/10.3390/info17080765
Submission received: 1 July 2026 / Revised: 30 July 2026 / Accepted: 4 August 2026 / Published: 10 August 2026
(This article belongs to the Special Issue Reliable and Secure AI Systems)

Abstract

Large language model (LLM)-based assistants can make large sociological survey collections more accessible, but they may also increase the exposure of respondent-level information and socially sensitive content. This study presents SocioTable-KZ, a privacy-aware, risk-reducing pipeline for bilingual natural-language interpretation of relational sociological survey data from Kazakhstan. The source collection contains 2,385,890 records distributed across 28 linked tables. The pipeline combines identifier exclusion, deterministic JoinGraph serialisation, language-specific QLoRA adaptation of Qwen-family models, a three-class Safe–Sensitive–Unsafe safety module, constrained rewriting, and controlled release. Reference analytical texts were prepared through expert-curated seed examples followed by few-shot candidate generation and factual review. Generation experiments used independent Kazakh and Russian 80/10/10 splits with seed 42. The best reported Qwen3-4B configuration achieved BLEU/ROUGE-L/chrF scores of 29.07/49.88/58.31 for Kazakh and 46.67/65.00/68.40 for Russian. The safety-labelled corpus contained 1347 Kazakh and 3376 Russian instances. On the reported Kazakh evaluation corpus, the safety module achieved 0.925 accuracy and F1-scores of 0.87, 0.95, and 0.70 for Safe, Sensitive, and Unsafe, respectively; Unsafe recall was 0.59. The revised deployment protocol therefore prohibits unattended respondent-level release and requires deterministic identifier screening and human review for non-Safe or uncertain outputs. An official letter from the original data-collecting institution confirms active informed consent and authorised scientific use of the anonymised dataset. The evidence supports preliminary feasibility, not a formal privacy guarantee or production-readiness claim.

1. Introduction

Large language model (LLM)-based assistants are increasingly used to make complex information accessible through natural-language interaction. In sociological research, such systems can help analysts, decision makers, and non-specialist users interpret findings stored in relational databases, coded response fields, and reference tables. However, generative access to survey data creates risks that extend beyond linguistic fluency. Survey databases may contain demographic characteristics, geographical information, political or religious views, perceptions of social justice, health-related information, and free-text responses. When those data are transformed into readable narratives, the system may reveal sensitive attributes, enable re-identification through combinations of quasi-identifiers, reproduce harmful framing, or present an individual response as a population-level conclusion.
Unlike general web text, survey responses are collected from human participants for defined research purposes and under expectations of confidentiality. The fact that an LLM can produce a coherent description does not imply that every available attribute should be reproduced. Automated generation changes the accessibility of the data: information previously available only to authorised analysts can be reformulated and delivered directly through a conversational interface. This transformation creates an obligation to minimise unnecessary disclosure, preserve respondent autonomy, avoid unsupported generalisations, and keep released text consistent with the original purpose of data collection.
Several risks make the problem consequential. Direct identifiers may occur in source fields or free-text responses. Even after their removal, combinations such as exact age, locality, survey wave, and rare response content may increase indirect identification risk. Classical privacy models, including k-anonymity and -diversity, show that removing direct identifiers alone is insufficient when attribute combinations reveal sensitive information [1,2]. Language models may also memorise and reproduce fragments of training data [3]. In addition, outputs may contain hallucinated claims, discriminatory framing, or unwarranted social inference [4,5].
This study proposes SocioTable-KZ, a privacy-aware bilingual pipeline for generating natural-language interpretations from interconnected sociological survey data. The expression privacy-aware is used deliberately: the method implements risk-reducing controls but does not claim differential privacy, cryptographic confidentiality, or a proven upper bound on re-identification risk. The pipeline combines protected relational-data preparation, deterministic JoinGraph serialisation, language-specific QLoRA adaptation, a domain-specific safety taxonomy, constrained rewriting, and controlled release.
The revised study makes five contributions:
  • A deterministic JoinGraph representation for minimised, auditable serialisation of linked survey tables;
  • A bilingual QLoRA generation procedure with independent Kazakh and Russian adapters and held-out automatic evaluation;
  • A documented two-stage safety annotation protocol with three expert annotators and a conservative Safe–Sensitive–Unsafe taxonomy;
  • Operational rules for identifier exclusion, quasi-identifier generalisation, human review, audit logging, and release control;
  • An explicit evidence map distinguishing empirically evaluated components from design choices that still require controlled ablation and formal privacy evaluation.
The remainder of the paper is organised as follows. Section 2 reviews relational data-to-text generation, low-resource multilingual adaptation, and safety and privacy research. Section 3 describes data provenance, consent, target construction, JoinGraph serialisation, model adaptation, safety annotation, and deployment controls. Section 4 reports generation, training, safety, and operational-control results. Section 5 discusses architectural implications and limitations. Section 6 concludes the paper.

2. Related Work

2.1. Relational Data-to-Text Generation and Factuality

Data-to-text generation has progressed from templates and statistical realisation to neural and instruction-tuned models [6,7]. Structured representations improve content selection, but fluent text can still contain unsupported facts or omit source information. NLI-based evaluation has therefore been proposed to measure whether generated text contains all and only facts supported by the input [8]. Recent evaluation of open LLMs confirms that fluency does not guarantee semantic accuracy and motivates source-grounded and human evaluation [9]. Most established benchmarks represent a single table or compact record; they do not directly model the foreign-key dependencies and data-minimisation requirements of a 28-table sociological database.

2.2. Parameter-Efficient and Low-Resource Multilingual Adaptation

LoRA and QLoRA reduce adaptation cost by training low-rank updates while keeping the backbone frozen or quantised [10,11]. Their efficiency is useful for bilingual domain adaptation, but data imbalance can produce unequal quality across languages. This concern is particularly relevant for Kazakh, for which dedicated benchmarks and model resources remain limited. KazMMLU demonstrates persistent performance gaps for Kazakh and Kazakhstan-specific knowledge even among strong multilingual models [12]. Language-specific adapters can reduce direct competition between a larger Russian subset and a smaller Kazakh subset, although a shared-adapter baseline is still needed to isolate the effect experimentally.

2.3. Multilingual Safety, PII Control, and Formal Privacy

General guardrails and safety benchmarks evaluate harmful content and model refusals [13,14]. Multilingual safety studies show that non-English behaviour can differ substantially from English behaviour, so safety evaluation should be language-specific rather than assumed to transfer automatically [15]. PII redaction and classify-and-rewrite mechanisms can reduce disclosure, but they do not provide formal privacy guarantees. Differentially private fine-tuning provides a stronger, mathematically defined alternative, although it introduces a privacy–utility trade-off and was not implemented in the present study [16]. SocioTable-KZ therefore combines deterministic data minimisation and release governance with a learned safety module, while explicitly treating residual risk as unresolved.
At the governance level, global AI ethics guidelines, principle-based frameworks, critiques of principle-only approaches, and the NIST AI Risk Management Framework provide complementary foundations for transparency, accountability, human oversight, and operational risk management [17,18,19,20].
Table 1 summarises the positioning of SocioTable-KZ relative to adjacent data-to-text, LLM guardrail, PII-redaction, and privacy-preserving approaches.

3. Methodology

3.1. System Overview

Figure 1 presents the revised system architecture. Source records are cleaned, direct identifiers are excluded, and quasi-identifiers are typed before serialisation. The active relational context is transformed into a deterministic JoinGraph sequence and passed to a Qwen-family model with a language-specific QLoRA adapter. The candidate response is then assessed by the safety layer. Safe outputs can proceed to controlled release; Sensitive outputs are generalised or rewritten and rechecked; and Unsafe or uncertain outputs are withheld for human review.

3.2. Data Source, Secondary-Analysis Status, and Informed Consent

The protected source database contains 2,385,890 records distributed across 28 interconnected tables and covers sociological surveys conducted in Kazakhstan between 2011 and 2024. The original data collection was performed by the Institute of Philosophy, Political Science and Religious Studies, Committee of Science, Ministry of Science and Higher Education of the Republic of Kazakhstan. The authors of the present study did not recruit respondents, conduct interviews, or access direct identifiers; they performed secondary computational analysis on an analytical dataset anonymised before transfer.
The data-providing institution issued an official signed and stamped confirmation dated 30 July 2026 (Letter No. 01-11/244-Sh). The letter confirms that participation in the original surveys was voluntary and that consent was actively documented before access to substantive questions through the mandatory question “Do you agree to participate voluntarily in this survey?” Only respondents who selected “Yes, I agree” proceeded; respondents who selected “No, I do not agree” were not included. Before consent, respondents were informed about the organisation conducting the survey, the purpose of the research, confidentiality, scientific and academic-publication use, and the right to refuse or discontinue participation. The letter further confirms that the dataset supplied to the authors contained no names, telephone numbers, email addresses, identification numbers, exact residential addresses, or other direct identifiers and authorised scientific analysis and aggregated publication.
No retrospective ethics approval is claimed for the historical surveys. The present manuscript reports the consent confirmation transparently and limits its claims to secondary analysis of the anonymised dataset.

3.3. Data Preparation and Construction of Supervised Targets

The answers table served as the central fact table and was joined to question texts, survey themes, years, keywords, respondent-related attributes, response variants, and code values. Open-ended responses stored in answer_text and predefined responses stored in answer_variant were normalised into the unified field answer_final as follows:
answer _ final = answer _ text , if answer _ text , answer _ variant , otherwise .
Null values, malformed records, redundant technical fields, and duplicate representations were removed. The resulting model records contained the survey theme, year, question title, keyword, normalised answer, target language, and only the generalised contextual fields permitted by the privacy policy. Supervised target_text paragraphs were prepared in two stages. First, domain experts curated a seed set defining the expected analytical style, neutral terminology, and restrictions on unsupported inference. Second, candidate paragraphs were generated through few-shot prompting with Qwen models and reviewed for factual consistency against the structured question–answer record before inclusion. Thus, automatic generation metrics measured agreement with reviewed reference texts; they did not replace an independent human evaluation of factuality, completeness, social appropriateness, or residual privacy risk.
The deduplicated generation subsets contained 1192 Kazakh and 6229 Russian instances. Each language was split independently into training, validation, and test partitions using an 80/10/10 ratio and a random seed of 42. Splitting by language prevents the larger Russian subset from determining the Kazakh validation and test composition.

3.4. JoinGraph Relational Serialisation

The schema is represented as a directed attributed graph G = ( V , E , λ , μ ) , where V contains table and attribute nodes, E contains relational edges, λ assigns structural roles, and μ labels foreign-key, reference, or aggregation relations. For record ρ , the active subgraph G ( ρ ) is the minimum connected subgraph containing non-null attributes necessary for interpretation. Its deterministic sequence is
s ( ρ ) = DFS G ( ρ ) , v fact , λ , μ ,
and the model prompt is
P ( q , ρ , ) = [ instruction ; query ; s ( ρ ) ; ] ,
where { Kazakh , Russian } . Deterministic ordering makes the input auditable and reduces schema noise. Every field is typed as an identifier, quasi-identifier, or content field before prompt construction.

3.5. Operational Rules for Identifiers and Quasi-Identifiers

Table 2 formalises the operational rules that were previously described only generally. Rules are applied before inference and, where necessary, again during output rewriting.
These operational rules were formulated with reference to the requirements of the Law of the Republic of Kazakhstan “On Personal Data and Their Protection” [21].

3.6. Bilingual QLoRA Generation

Qwen-family instruction models were adapted with 4-bit NF4 QLoRA [11]. LoRA rank was r = 32 , scaling α = 64 , and dropout 0.05 . Prompt tokens were assigned the ignore index 100 , so the causal-language-model objective was calculated only over target tokens:
L ( θ ) = t = m + 1 T log p θ ( x t x < t ) .
Training used AdamW-8bit, a cosine learning-rate schedule, a learning rate of 2 × 10 4 , a weight decay of 0.01 , a warm-up ratio of 0.03 , a maximum gradient norm of 0.3 , a per-device batch size of 4, a gradient accumulation of 4, and a maximum sequence length of 1408 tokens (1024 prompt and 384 target tokens). Separate Kazakh and Russian adapters were trained. Later comparative runs were limited to three epochs, validation was checked every 100 steps, and early stopping used patience 3; these settings were introduced after the four-epoch prototype run showed a validation-loss rebound.

3.7. Safety Taxonomy, Annotation, and Classify-and-Rewrite Module

The safety taxonomy contains three classes:
  • Safe: no direct identifier, prohibited quasi-identifier combination, or socially harmful framing requiring intervention;
  • Sensitive: indirect identifiers or context-dependent social content requiring generalisation, qualification, or human review;
  • Unsafe: direct PII, precise geolocation, or content that must not be released automatically.
Borderline cases are conservatively escalated from Safe to Sensitive.
Annotation was conducted in two stages. A rule-based tagger first flagged Kazakhstan-format telephone numbers, user-identifier strings, and postal-code patterns, while Gemini was used as a zero-shot bootstrap labeler. These automatic assignments were drafts. Three domain experts then independently labelled a stratified sample of 2000 generated texts. Disagreements were resolved by majority vote, with borderline Sensitive cases adjudicated by a senior annotator. Fleiss’ κ for the three annotators was 0.81. The adjudicated safety set was partitioned into training, validation, and test sets using a 70/15/15 split.
The safety component is a single bilingual instruction-tuned Qwen3.5-4B model adapted with LoRA. Its fixed input template contains the survey question and normalised answer; its target contains a structured label and, for non-Safe cases, a constrained rewrite:
  • Safety: <Safe | Sensitive | Unsafe>
  • Rewrite: <neutralised and de-identified text>
  • The same prompt-masking principle is used as in generation. Decoding is greedy with a mild repetition penalty. The historical run retained the naturally imbalanced class distribution and did not apply post hoc resampling. Because the class is emitted as a token sequence rather than selected from calibrated logits, it also did not use an independently optimised probability threshold. These choices are limitations for the rare Unsafe class and motivate future cost-sensitive training and discriminative calibration.

3.8. Deployment Protocol and Interim Risk Mitigation

The reported Unsafe recall is insufficient for unattended respondent-level release. The revised protocol therefore requires the following safeguards:
  • Public-facing access is restricted to aggregate results; respondent-level generation is limited to authorised analysts.
  • Deterministic PII screening is applied before model inference and again before release.
  • Sensitive, Unsafe, malformed, or uncertain outputs are withheld from automatic delivery and require human review.
  • Audit logs record the query, data scope, model version, safety decision, rewrite decision, and reviewer action.
  • Access to and use of the data must remain consistent with the scope of the original informed consent and the applicable data-sharing agreement.
  • Annotation guidance and borderline examples are periodically re-adjudicated as legal and social expectations evolve.
These controls are deployment requirements rather than evidence that the current prototype is production-ready.

3.9. Evaluation Scope

Generation quality is evaluated on held-out language-specific test sets using BLEU-4, ROUGE-1/2/L, chrF, METEOR, token F1, and Exact Match. These metrics assess overlap and surface-level semantic agreement with reviewed references but do not directly measure respondent re-identification risk. Safety performance is reported with per-class precision, recall, and F1, macro and weighted averages, and special emphasis on Unsafe recall. Operational privacy handling is quantified through the proportion of annotated cases routed to direct release, rewrite/review, or blocking. No formal differential-privacy budget, membership-inference test, reconstruction attack, or expert rewrite-fidelity evaluation is claimed.

4. Results

4.1. Corpus and Safety-Label Distribution

The safety-labelled corpus contained 1347 Kazakh and 3376 Russian instances. Table 3 shows that Sensitive records represented 75.1% in both languages, while Unsafe records were rare.
The distribution of the three safety categories across the Kazakh and Russian subsets is visualised in Figure 2.

4.2. Held-Out Bilingual Generation Evaluation

Table 4 reports held-out automatic results for two Qwen backbones. Qwen3-4B outperformed Qwen2.5-3B in both languages. Russian scores were higher than Kazakh scores across all metrics, consistent with the larger Russian training subset and broader Russian pretraining coverage. Exact Match remained low because multiple valid surface formulations can express the same structured record.
These results strengthen the empirical basis beyond validation loss, but they do not by themselves establish factual completeness, absence of hallucinations, or social appropriateness. Qualitative inspection found that rare answer categories sometimes produced generic interpretations and that Kazakh outputs occasionally contained Russian technical terms. A blinded expert study and a source-grounded factuality metric remain necessary.

4.3. Training Dynamics and Overfitting Analysis

In the four-epoch prototype run, training loss decreased from 0.1476 to 0.0490. Validation loss decreased from 0.2220 to 0.1569 at epoch 3 and then increased to 0.1807 at epoch 4 (Figure 3). The divergence is consistent with incipient overfitting: the adapter continued fitting the limited domain corpus after validation performance had peaked. Likely contributors include the small Kazakh subset, repeated analytical templates, class and language imbalance, and an additional epoch after the validation minimum.
The epoch 3 checkpoint was therefore retained. Subsequent comparative configurations used a maximum of three epochs, validation every 100 steps, early stopping with a patience of 3, dropout of 0.05, and weight decay of 0.01. These controls mitigate but do not eliminate overfitting, and the result should not be interpreted as proof of factual or privacy performance.

4.4. Safety Classification Performance

Table 5 reports the archived Kazakh evaluation corpus. The model achieved an accuracy of 0.925, weighted F1 of 0.920, and macro F1 of 0.840. Unsafe recall was 0.59, corresponding to an estimated false-negative rate of 0.41 under the reported rounded values.
The Unsafe class contains only 44 examples, and its low recall is the most consequential limitation. The metric means that the classifier cannot serve as the sole release gate. The revised protocol therefore applies deterministic screening and human review to respondent-level, non-Safe, or uncertain outputs. Equivalent Russian prediction metrics were not retained in the archived evaluation report; the manuscript now states this limitation rather than implying bilingual validation of the safety classifier.

4.5. Quantitative Operational Privacy-Control Assessment

The method does not provide formal privacy guarantees, but the annotated corpus allows the release policy to be quantified. Table 6 shows the share of records assigned to direct release, rewrite/review, or blocking. Under this policy, 78.4% of Kazakh and 76.5% of Russian annotated instances receive an intervention rather than direct release.
This is an operational coverage measure, not an estimate of re-identification probability. The remaining quantitative risk evidence is the Unsafe false-negative rate of approximately 0.41. Formal evaluation would require attack-based testing, membership or reconstruction analysis, and a validated privacy–utility study of rewritten outputs.

4.6. Evidence for Individual Components

Reviewer concerns about ablation motivated an explicit evidence audit (Table 7). The current experiments compare language and model configurations but do not isolate every architectural contribution. The revision therefore narrows causal claims.
Accordingly, SocioTable-KZ is presented as an integrated, preliminary framework. The results do not prove that each component independently causes the observed performance improvement.

4.7. Prototype Deployment

The selected generator and safety module were integrated into a Telegram prototype. Figure 4 shows aggregate safety statistics and a generated analysis with a visible safety label. The interface demonstrates implementation feasibility but is not a user study or evidence of unattended deployment readiness.

5. Discussion

The main architectural implication is that privacy risk is distributed across the pipeline rather than concentrated in one classifier. JoinGraph contributes by limiting the model input to an active connected subgraph and preserving the provenance of each field. This structure supports auditability: analysts can inspect which attributes entered a prompt and why. A flat prompt may contain the same values, but it does not provide the same explicit relationship and minimisation logic. Controlled ablation against flat serialisation remains necessary to quantify the performance contribution.
Language-specific adapters address a different problem. The Russian subset is substantially larger, and the held-out results show a 15.12-point ROUGE-L gap and a 17.60-point BLEU gap between Russian and Kazakh for Qwen3-4B. Independent adapters prevent the larger language from directly dominating a shared update and allow targeted Kazakh improvement. However, separate adapters increase maintenance cost and do not prove that they outperform a balanced shared adapter. The language gap is therefore treated as an empirical equity concern, not merely a technical detail.
The privacy–utility trade-off is clearest in quasi-identifier generalisation. Exact ages and localities can increase analytical specificity but may also permit re-identification when combined with rare answers. The hierarchy in Table 2 preserves broader sociological meaning while reducing specificity. Aggressive generalisation can remove useful distinctions, whereas weak generalisation can leave residual disclosure risk. The present study quantifies routing decisions but does not yet quantify rewrite fidelity or residual identifiability.
The generator and safety module are interdependent. A fluent generator can produce a factually faithful but ethically inappropriate respondent-level narrative; conversely, an overly conservative safety module may suppress legitimate aggregate analysis. The three-class taxonomy allows a middle state in which content is not treated as harmless but can be generalised and reviewed. The low Unsafe recall shows that this learned module must remain subordinate to deterministic screening and human governance.
Several limitations remain. First, the reported safety metrics are available only for the Kazakh evaluation corpus; equivalent Russian predictions and threshold curves are required. Second, the historical safety module emits labels through generation rather than calibrated class probabilities. Third, automatic generation metrics do not directly quantify hallucination, factual completeness, or expert acceptability. Fourth, the component analysis is not a full empirical ablation. Fifth, no formal differential privacy, membership-inference evaluation, or reconstruction attack was performed. Sixth, the consent confirmation supports authorised secondary use of anonymised data but is not a retrospective institutional ethics approval for the historical surveys. These limitations restrict the conclusion to preliminary feasibility.

6. Conclusions

SocioTable-KZ integrates deterministic relational serialisation, bilingual parameter-efficient adaptation, safety annotation, constrained rewriting, and controlled release for sociological survey data. The revised evaluation adds held-out generation metrics, a documented target-construction and annotation process, an explicit overfitting analysis, operational quasi-identifier rules, a quantified release-policy assessment, and an evidence map for each architectural component.
The strongest generation configuration achieved BLEU/ROUGE-L/chrF of 29.07/49.88/58.31 for Kazakh and 46.67/65.00/68.40 for Russian. The safety module achieved 0.925 accuracy on the reported Kazakh evaluation corpus, but Unsafe recall of 0.59 precludes unattended respondent-level release. The system must therefore be used with deterministic PII screening, restricted access, human review, audit logging, and periodic re-annotation.
The framework should be understood as a privacy-aware and risk-reducing methodology rather than a formally privacy-preserving system. Future work will conduct controlled JoinGraph and adapter ablations, evaluate Russian safety performance, calibrate Unsafe detection, measure factual completeness and rewrite fidelity with expert review, and investigate differentially private adaptation.

Author Contributions

Conceptualization, A.O. and M.M.; methodology, A.O., Z.Z. and A.Z.; software, A.O., Z.Z. and A.Z.; validation, A.O. and M.M.; formal analysis, A.O.; data curation, A.O., Z.Z. and A.Z.; writing—original draft preparation, A.O.; writing—review and editing, A.O. and M.M.; supervision, M.M.; project administration, A.O. All authors have read and agreed to the published version of the manuscript.

Funding

This computational research was funded by the Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan, grant BR24993001, “Creation of a large language model (LLM) to support the Kazakh language and technological progress”.

Institutional Review Board Statement

The study involved the secondary analysis of previously collected and anonymized non-biomedical sociological survey data. No new participants were recruited, no additional primary data were collected, and the authors had no access to direct personal identifiers. The Quality and Ethics Committee of the Institute of Philosophy, Political Science and Religious Studies determined that separate prospective ethics approval was not required for this secondary analysis (Protocol No. 5, 31 August 2025; official determination issued on 3 August 2026, Ref. No. 01-11/248-III). The data were processed in accordance with Article 17 of the Law of the Republic of Kazakhstan No. 94-V of 21 May 2013, “On Personal Data and Their Protection”.

Informed Consent Statement

Informed consent was obtained from all respondents included in the original sociological surveys. Before the substantive questionnaire, respondents received information about the organisation conducting the survey, the research purpose, voluntary participation, confidentiality, scientific and academic-publication use, and the right to refuse or discontinue. Consent was actively recorded through the mandatory question “Do you agree to participate voluntarily in this survey?” Only respondents who selected “Yes, I agree” proceeded; those who selected “No, I do not agree” were not included. A separate signed consent sheet was not used. The data-providing institution confirmed this procedure in writing on 30 July 2026.

Data Availability Statement

Restrictions apply to the respondent-level sociological survey data. The authors received an anonymised analytical dataset under institutional data-sharing conditions and are not authorised to redistribute it. Source code and aggregate supporting outputs may be shared after institutional de-identification and release review. Access to approved anonymised derivatives may be requested from the data provider and is subject to ethical, legal, and institutional approval.

Acknowledgments

The authors gratefully acknowledge the Institute of Philosophy, Political Science and Religious Studies of the Committee of Science, Ministry of Science and Higher Education of the Republic of Kazakhstan, for providing the anonymised analytical survey dataset and the official confirmation of the informed consent procedure and authorised scientific use of the data. The underlying sociological survey data were collected within project BR28713047 “Artificial Intelligence and the Ethics of Social Justice: A Conceptual Analysis of Opportunities and Risks in the Processes of Societal Modernization in Kazakhstan”.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Sweeney, L. k-Anonymity: A Model for Protecting Privacy. Int. J. Uncertain. Fuzziness Knowl.-Based Syst. 2002, 10, 557–570. [Google Scholar] [CrossRef]
  2. Machanavajjhala, A.; Kifer, D.; Gehrke, J.; Venkitasubramaniam, M. -Diversity: Privacy Beyond k-Anonymity. ACM Trans. Knowl. Discov. Data 2007, 1, 3. [Google Scholar] [CrossRef]
  3. Carlini, N.; Tramèr, F.; Wallace, E.; Jagielski, M.; Herbert-Voss, A.; Lee, K.; Roberts, A.; Brown, T.; Song, D.; Erlingsson, Ú.; et al. Extracting Training Data from Large Language Models. In Proceedings of the 30th USENIX Security Symposium (USENIX Security 21); USENIX Association: Berkeley, CA, USA, 2021; pp. 2633–2650. [Google Scholar]
  4. Ji, Z.; Lee, N.; Frieske, R.; Yu, T.; Su, D.; Xu, Y.; Ishii, E.; Bang, Y.; Madotto, A.; Fung, P. Survey of Hallucination in Natural Language Generation. ACM Comput. Surv. 2023, 55, 248. [Google Scholar] [CrossRef]
  5. Weidinger, L.; Mellor, J.; Rauh, M.; Griffin, C.; Uesato, J.; Huang, P.-S.; Cheng, M.; Glaese, M.; Balle, B.; Kasirzadeh, A.; et al. Ethical and Social Risks of Harm from Language Models. arXiv 2021, arXiv:2112.04359. [Google Scholar]
  6. Gatt, A.; Krahmer, E. Survey of the State of the Art in Natural Language Generation. J. Artif. Intell. Res. 2018, 61, 65–170. [Google Scholar] [CrossRef]
  7. Parikh, A.; Wang, X.; Gehrmann, S.; Faruqui, M.; Dhingra, B.; Yang, D.; Das, D. ToTTo: A Controlled Table-to-Text Generation Dataset. In Proceedings of EMNLP 2020; Association for Computational Linguistics: Stroudsburg, PA, USA, 2020; pp. 1173–1186. [Google Scholar] [CrossRef]
  8. Dušek, O.; Kasner, Z. Evaluating Semantic Accuracy of Data-to-Text Generation with Natural Language Inference. In Proceedings of INLG 2020; Association for Computational Linguistics: Stroudsburg, PA, USA, 2020; pp. 131–137. [Google Scholar] [CrossRef]
  9. Kasner, Z.; Dušek, O. Beyond Traditional Benchmarks: Analyzing Behaviors of Open LLMs on Data-to-Text Generation. In Proceedings of ACL 2024; Association for Computational Linguistics: Stroudsburg, PA, USA, 2024; pp. 12045–12072. [Google Scholar] [CrossRef]
  10. Hu, E.J.; Shen, Y.; Wallis, P.; Allen-Zhu, Z.; Li, Y.; Wang, S.; Wang, L.; Chen, W. LoRA: Low-Rank Adaptation of Large Language Models. In Proceedings of the ICLR 2022, International Conference on Learning Representations, Virtual, 25–29 April 2022. [Google Scholar]
  11. Dettmers, T.; Pagnoni, A.; Holtzman, A.; Zettlemoyer, L. QLoRA: Efficient Finetuning of Quantized LLMs. In Advances in Neural Information Processing Systems; Neural Information Processing Systems Foundation, Inc.: La Jolla, CA, USA, 2023; Volume 36, pp. 10088–10115. [Google Scholar] [CrossRef]
  12. Togmanov, M.; Mukhituly, N.; Turmakhan, D.; Mansurov, J.; Goloburda, M.; Sakip, A.; Xie, Z.; Wang, Y.; Syzdykov, B.; Laiyk, N.; et al. KazMMLU: Evaluating Language Models on Kazakh, Russian, and Regional Knowledge of Kazakhstan. In Proceedings of ACL 2025; Association for Computational Linguistics: Stroudsburg, PA, USA, 2025; pp. 14403–14416. [Google Scholar] [CrossRef]
  13. Inan, H.; Upasani, K.; Chi, J.; Rungta, R.; Iyer, K.; Mao, Y.; Tontchev, M.; Hu, Q.; Fuller, B.; Testuggine, D.; et al. Llama Guard: LLM-Based Input-Output Safeguard for Human-AI Conversations. arXiv 2023, arXiv:2312.06674. [Google Scholar]
  14. Zhang, Z.; Lei, L.; Wu, L.; Sun, R.; Huang, Y.; Long, C.; Liu, X.; Lei, X.; Tang, J.; Huang, M. SafetyBench: Evaluating the Safety of Large Language Models. In Proceedings of ACL 2024; Association for Computational Linguistics: Stroudsburg, PA, USA, 2024; pp. 15537–15553. [Google Scholar] [CrossRef]
  15. Wang, W.; Tu, Z.; Chen, C.; Yuan, Y.; Huang, J.-T.; Jiao, W.; Lyu, M. All Languages Matter: On the Multilingual Safety of LLMs. In Findings of ACL 2024; Association for Computational Linguistics: Stroudsburg, PA, USA, 2024; pp. 5865–5877. [Google Scholar] [CrossRef]
  16. Li, X.; Tramèr, F.; Liang, P.; Hashimoto, T. Large Language Models Can Be Strong Differentially Private Learners. In Proceedings of the ICLR 2022; International Conference on Learning Representations, Virtual, 25–29 April 2022. [Google Scholar]
  17. Jobin, A.; Ienca, M.; Vayena, E. The Global Landscape of AI Ethics Guidelines. Nat. Mach. Intell. 2019, 1, 389–399. [Google Scholar] [CrossRef]
  18. Floridi, L.; Cowls, J. A Unified Framework of Five Principles for AI in Society. Harv. Data Sci. Rev. 2019, 1. [Google Scholar] [CrossRef]
  19. Mittelstadt, B. Principles Alone Cannot Guarantee Ethical AI. Nat. Mach. Intell. 2019, 1, 501–507. [Google Scholar] [CrossRef]
  20. Tabassi, E. Artificial Intelligence Risk Management Framework (AI RMF 1.0); NIST AI 100-1; National Institute of Standards and Technology: Gaithersburg, MD, USA, 2023. [CrossRef]
  21. Republic of Kazakhstan. Law No. 94-V “On Personal Data and Their Protection”; Parliament of the Republic of Kazakhstan: Astana, Kazakhstan, 2013.
Figure 1. End-to-end SocioTable-KZ architecture. The learned safety label is a decision signal inside a wider governance process and is not treated as a stand-alone privacy guarantee.
Figure 1. End-to-end SocioTable-KZ architecture. The learned safety label is a decision signal inside a wider governance process and is not treated as a stand-alone privacy guarantee.
Information 17 00765 g001
Figure 2. Safe, Sensitive, and Unsafe annotation distribution. The predominance of Sensitive content reflects the subject matter of sociological surveys and does not mean that the source records are inherently harmful.
Figure 2. Safe, Sensitive, and Unsafe annotation distribution. The predominance of Sensitive content reflects the subject matter of sociological surveys and does not mean that the source records are inherently harmful.
Information 17 00765 g002
Figure 3. Training and validation loss in the four-epoch prototype run. Validation loss reaches its minimum at epoch 3 and rebounds at epoch 4, motivating checkpoint selection and stricter early stopping.
Figure 3. Training and validation loss in the four-epoch prototype run. Validation loss reaches its minimum at epoch 3 and rebounds at epoch 4, motivating checkpoint selection and stricter early stopping.
Information 17 00765 g003
Figure 4. Telegram prototype implementing the SocioTable-KZ workflow. The panels are AI-assisted illustrative reconstructions based on anonymised screenshots of the original interface. For respondent-level use, the safeguards described in Section 3.8 are required.
Figure 4. Telegram prototype implementing the SocioTable-KZ workflow. The panels are AI-assisted illustrative reconstructions based on anonymised screenshots of the original interface. For respondent-level use, the safeguards described in Section 3.8 are required.
Information 17 00765 g004
Table 1. Positioning of SocioTable-KZ relative to adjacent approaches.
Table 1. Positioning of SocioTable-KZ relative to adjacent approaches.
ApproachRelational StructureBilingual/Low-Resource FocusPrivacy or Safety ControlDistinct Scope of SocioTable-KZ
Conventional table-to-text benchmarksUsually one table or compact recordUsually not Kazakh–Russian-specificMainly factuality and fluencyForeign-key-aware serialisation over 28 linked survey tables
General LLM guardrailsUnstructured prompts and outputsMultilingual coverage variesGeneric harmful-content policySociological Safe–Sensitive–Unsafe taxonomy and quasi-identifier rules
PII redaction pipelinesField or span detectionLanguage-specific tools may be requiredRemoves recognised direct identifiersCombines pre-inference exclusion, generalisation, rewrite, and release control
Differentially private fine-tuningModel-training focusApplicable across languagesFormal privacy accountingNot implemented; identified as necessary for future formal guarantees
SocioTable-KZDeterministic JoinGraph active subgraphSeparate Kazakh and Russian adaptersDefence-in-depth, human review, and controlled releaseIntegrated relational, linguistic, safety, and governance workflow
Table 2. Operational disclosure-control rules.
Table 2. Operational disclosure-control rules.
Attribute TypeExamplesPrompt RuleOutput Rule
Direct identifiername, telephone, email, user identifier, exact addressExcluded before serialisationReplace accidental occurrence with typed placeholder and block automatic release
Exact agenumeric ageConvert to decade bracket when context is neededUse age range; suppress for rare combinations
Precise localityvillage, street, exact settlementPromote to region or larger administrative unitRelease only generalised location
Rare category combinationage + locality + rare answerRemove the least analytically necessary fieldEscalate to Sensitive and require review
Respondent referencerow-level person descriptionUse neutral participant tokenAvoid language implying identification or representativeness
Aggregate statisticsufficiently broad group resultRetain when permitted by query and data-sharing termsMay be released with scope and denominator stated
Table 3. Distribution of safety labels by language.
Table 3. Distribution of safety labels by language.
LanguageSafeSensitiveUnsafeTotal
Kazakh292 (21.7%)1011 (75.1%)44 (3.3%)1347
Russian792 (23.5%)2536 (75.1%)48 (1.4%)3376
Table 4. Automatic generation metrics on held-out test sets (values in percentage points).
Table 4. Automatic generation metrics on held-out test sets (values in percentage points).
ModelBLEUR-1R-2R-LchrFMETEORToken F1EM
Qwen3-4B (KZ)29.0752.6735.4449.8858.3149.8952.442.00
Qwen3-4B (RU)46.6767.0152.4665.0068.4060.4163.6210.00
Qwen2.5-3B (KZ)26.6947.5130.4145.6255.6345.0847.180.00
Qwen2.5-3B (RU)41.7263.2147.2661.2265.5556.3560.0210.00
Table 5. Safety-module performance on the reported Kazakh evaluation corpus.
Table 5. Safety-module performance on the reported Kazakh evaluation corpus.
CategoryPrecisionRecallF1-ScoreSupport
Safe0.8300.9000.870292
Sensitive0.9600.9500.9501011
Unsafe0.8700.5900.70044
Macro average0.8870.8130.8401347
Weighted average0.9300.9250.9201347
Accuracy0.9251347
Table 6. Operational disposition of annotated records under the SocioTable-KZ release policy.
Table 6. Operational disposition of annotated records under the SocioTable-KZ release policy.
LanguageSafe/DirectSensitive/ReviewUnsafe/BlockIntervention
Kazakh21.7%75.1%3.3%78.4%
Russian23.5%75.1%1.4%76.5%
Table 7. Evidence status for the proposed components.
Table 7. Evidence status for the proposed components.
ComponentAvailable EvidenceRemaining Ablation
Qwen backbone sizeQwen3-4B outperforms Qwen2.5-3B in both languagesBroader model and seed comparison
Language-specific adaptersSeparate KZ/RU held-out metrics expose the language gapShared bilingual-adapter baseline
JoinGraph serialisationDeterministic schema preservation and auditable active-subgraph designFlat-concatenation and schema-free baselines
Prompt maskingTarget-only objective is specified and reproducibleFull-sequence-loss baseline
Safety modulePer-class KZ report and intervention coverageNo-guardrail baseline, calibrated thresholds, and RU metrics
Constrained rewriteOperational hierarchy and examplesExpert fidelity and residual-risk evaluation
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ospan, A.; Mansurova, M.; Zhangabay, Z.; Zhappar, A. SocioTable-KZ: Ethical and Privacy-Aware Bilingual Generation from Sociological Survey Data. Information 2026, 17, 765. https://doi.org/10.3390/info17080765

AMA Style

Ospan A, Mansurova M, Zhangabay Z, Zhappar A. SocioTable-KZ: Ethical and Privacy-Aware Bilingual Generation from Sociological Survey Data. Information. 2026; 17(8):765. https://doi.org/10.3390/info17080765

Chicago/Turabian Style

Ospan, Assel, Madina Mansurova, Zhansaya Zhangabay, and Aktoty Zhappar. 2026. "SocioTable-KZ: Ethical and Privacy-Aware Bilingual Generation from Sociological Survey Data" Information 17, no. 8: 765. https://doi.org/10.3390/info17080765

APA Style

Ospan, A., Mansurova, M., Zhangabay, Z., & Zhappar, A. (2026). SocioTable-KZ: Ethical and Privacy-Aware Bilingual Generation from Sociological Survey Data. Information, 17(8), 765. https://doi.org/10.3390/info17080765

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop