Hypergraph Neural Networks for Cross-domain Text-to-SQL

doi:10.19678/j.issn.1000-3428.0069127

Abstract

Abstract:

Graph Neural Network (GNN) have been widely used as encoders in recent years for cross-domain Text-to-SQL. The encoding process based on GNN substantially improves the generalization of generative models under cross-domain Text-to-SQL by capturing the association information between database schema and natural language questions. Existing GNN approaches have limitations in the heterogeneous graph structure encoding learning process, and the node-centered linking prediction of database schema and natural language questions is prone to mismatch in complex semantic scenarios. To address this issue, we propose a heterogeneous graph learning framework for cross-domain Text-to-SQL. We propose relational edge subgraph construction and edge hypergraph attention network for the edge-centered learning process of heterogeneous graphs, to effectively learn the differentiated structural features of relational edges and nodes in heterogeneous graphs, and to implement the effective generation of Structured Query Language (SQL) statements in complex semantic scenarios. To validate the effectiveness of the proposed framework, sufficient experimental comparisons are conducted on multiple cross-domain Text-to-SQL datasets. The results demonstrate that compared with the existing GNN baseline algorithms, the framework achieves significant improvement in both F1 value and Exact Matching Accuracy (EMA) metrics, and has stronger generalization in complex cross-domain scenarios.

Key words: Natural Language Processing (NLP), Text-to-SQL parsing, deep learning, graph construction, Graph Neural Network (GNN)

摘要：

近年来, 图神经网络(GNN)广泛-应用于跨域自然语言生成结构化查询语言(SQL)语句(Text-to-SQL)的编码器。基于GNN的编码过程通过捕获数据库架构和自然语言问题之间的关联信息, 大幅提高生成模型在跨域SQL语句生成下的泛化性。现有的GNN方法在异构图结构编码学习过程中存在缺陷, 以节点为中心进行数据库架构和自然语言问题的链接预测, 在复杂语义场景下容易出现错配。针对这一问题, 提出一种面向跨域Text-to-SQL的异构图学习框架。框架针对异构图以边为中心学习的过程提出关系边子图构建和边超图注意力网络, 有效学习异构图中关系边与节点的差异化结构特征, 实现复杂语义场景下SQL语句正确生成。为验证所提框架的有效性, 在多个跨域Text-to-SQL数据集上进行充分实验对比。结果表明, 相较于基线, 该框架在F1值和完全匹配准确率(EMA)指标上均取得显著提升, 且在复杂跨域场景下具有更强的泛化性。

关键词: 自然语言处理, 自然语言生成SQL语句解析, 深度学习, 图构建, 图神经网络

HAO Zhifeng, LI Yanglin, XU Boyan, CAI Ruichu. Hypergraph Neural Networks for Cross-domain Text-to-SQL[J]. Computer Engineering, 2025, 51(5): 114-123.

郝志峰, 黎阳霖, 许柏炎, 蔡瑞初. 面向跨域自然语言生成SQL语句的超图神经网络[J]. 计算机工程, 2025, 51(5): 114-123.

/ Recommend / Download Citations

URL: https://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0069127

https://www.ecice06.com/EN/Y2025/V51/I5/114

Figures/Tables 13

Fig.1 Overall framework of the proposed model

Fig.2 Linking prediction in graph neural network

Fig.3 Hypergraph conversion process

Fig.4 Hypergraph message delivery process

Fig.5 Visual alignment view of question words with database tables and columns

References 35

1	BAIK C, JAGADISH H V, LI Y Y. Bridging the semantic gap with SQL query logs in natural language interfaces to databases[C]//Proceedings of the IEEE 35th International Conference on Data Engineering. Washington D. C., USA: IEEE Press, 2019: 374-385.
2	ZHONG V, XIONG C M, SOCHER R. Seq2SQL: generating structured queries from natural language using reinforcement learning[EB/OL]. [2023-11-01]. https://arxiv.org/abs/1709.00103v7.
3	HE P C, MAO Y, CHAKRABARTI K, et al. X-SQL: reinforce schema representation with context[EB/OL]. [2023-11-01]. https://arxiv.org/abs/1908.08113v1.
4	ZHANG X Y , YIN F J , MA G J , et al. M-SQL: multi-task representation learning for single-table Text2SQL generation. IEEE Access, 2020, 8, 43156- 43167. doi: 10.1109/ACCESS.2020.2977613
5	吕剑清, 王先兵, 陈刚, 等. 面向工业生产的中文Text-to-SQL模型. 计算机应用, 2022, 42 (10): 2996- 3002.
	LÜ J Q , WANG X B , CHEN G , et al. Chinese Text-to-SQL model for industrial production. Journal of Computer Applications, 2022, 42 (10): 2996- 3002.
6	何佳壕, 刘喜平, 舒晴, 等. 带复杂计算的金融领域自然语言查询的SQL生成. 浙江大学学报(工学版), 2023, 57 (2): 277- 286.
	HE J H , LIU X P , SHU Q , et al. SQL generation from natural language queries with complex calculations on financial data. Journal of Zhejiang University (Engineering Science), 2023, 57 (2): 277- 286.
7	YU T, ZHANG R, YANG K, et al. Spider: a large-scale human-labeled dataset for complex and cross-domain semantic parsing and Text-to-SQL task[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2018: 3911-3921.
8	MIN Q K, SHI Y F, ZHANG Y. A pilot study for Chinese SQL semantic parsing[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2019: 3652-3658.
9	RAFFEL C , SHAZEER N , ROBERTS A , et al. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 2020, 21 (1): 5485- 5551.
10	LI J Y , HUI B Y , CHENG R , et al. Graphix-T5: mixing pre-trained transformers with graph-aware layers for Text-to-SQL parsing. Proceedings of the AAAI Conference on Artificial Intelligence, 2023, 37 (11): 13076- 13084. doi: 10.1609/aaai.v37i11.26536
11	LI H Y , ZHANG J , LI C P , et al. RESDSQL: decoupling schema linking and skeleton parsing for Text-to-SQL. Proceedings of the AAAI Conference on Artificial Intelligence, 2023, 37 (11): 13067- 13075. doi: 10.1609/aaai.v37i11.26535
12	BOGIN B, GARDNER M, BERANT J. Representing schema structure with graph neural networks for Text-to-SQL parsing[EB/OL]. [2023-11-01]. https://arxiv.org/abs/1905.06241v1.
13	WANG B L, SHIN R, LIU X D, et al. RAT-SQL: relation-aware schema encoding and linking for Text-to-SQL parsers[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2020: 1-10.
14	CHEN Z, CHEN L, ZHAO Y B, et al. ShadowGNN: graph projection neural network for Text-to-SQL parser[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, USA: ACL, 2021: 5567-5577.
15	CAI R C , YUAN J J , XU B Y , et al. SADGA: structure-aware dual graph aggregation network for Text-to-SQL. Advances in Neural Information Processing Systems, 2021, 34, 7664- 7676.
16	GAN Y J, CHEN X Y, PURVER M. Exploring underexplored limitations of cross-domain Text-to-SQL generalization[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2021: 8926-8931.
17	GAN Y J, CHEN X Y, HUANG Q P, et al. Towards robustness of Text-to-SQL models against synonym substitution[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2021: 2505-2515.
18	GUO J Q, ZHAN Z C, GAO Y, et al. Towards complex Text-to-SQL in cross-domain database with intermediate representation[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2019: 4524-4535.
19	曹合心, 赵亮, 李雪峰. 图神经网络在Text-to-SQL解析中的技术研究. 计算机科学, 2022, 49 (4): 110- 115.
	CAO H X , ZHAO L , LI X F . Technical research of graph neural network for Text-to-SQL parsing. Computer Science, 2022, 49 (4): 110- 115.
20	WANG B L, SHIN R, LIU X D, et al. RAT-SQL: relation-aware schema encoding and linking for Text-to-SQL parsers[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2020: 7567-7578.
21	HUI B Y, GENG R Y, WANG L H, et al. S2SQL: injecting syntax to question-schema interaction graph encoder for Text-to-SQL parsers[M]//DHABI A, EMIRATES U A. Findings of the Association for Computational Linguistics: ACL 2022. Stroudsburg, USA: ACL, 2022: 1254-1262.
22	CAO R S, CHEN L, CHEN Z, et al. LGESQL: line graph enhanced Text-to-SQL model with mixed local and non-local relations[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2021: 2541-2555.
23	XIANG Y Z, ZHANG Q W, ZHANG X, et al. G3R: a graph-guided generate-and-rerank framework for complex and cross-domain Text-to-SQL generation[C]//Proceedings of Annual Conference of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2023: 338-352.
24	SCHOLAK T, SCHUCHER N, BAHDANAU D. PICARD: parsing incrementally for constrained auto-regressive decoding from language models[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2021: 9895-9901.
25	XIE T B, WU C H, SHI P, et al. UnifiedSKG: unifying and multi-tasking structured knowledge grounding with text-to-text language models[C]//Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2022: 602-631.
26	QI J X, TANG J Y, HE Z W, et al. RASAT: integrating relational structures into pretrained Seq2Seq model for Text-to-SQL[C]//Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2022: 3215-3229.
27	RAI D, WANG B L, ZHOU Y L, et al. Improving generalization in language model-based Text-to-SQL semantic parsing: two simple semantic boundary-based techniques[EB/OL]. [2023-11-01]. https://arxiv.org/abs/2305.17378v1.
28	PENNINGTON J, SOCHER R, MANNING C. Glove: global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2014: 1532-1543.
29	CLARK K, LUONG M T, LE Q V, et al. ELECTRA: pre-training text encoders as discriminators rather than generators[EB/OL]. [2023-11-01]. https://arxiv.org/abs/2003.10555v1.
30	JO J, BAEK J, LEE S, et al. Edge representation learning with hypergraphs[C]//Proceedings of the 35th International Conference on Neural Information Processing Systems. New York, USA: ACM Press, 2024: 7534-7546.
31	VELIČKOVIĆ P, CUCURULL G, CASANOVA A, et al. Graph attention networks[EB/OL]. [2023-11-01]. https://arxiv.org/abs/1710.10903.
32	WANG K, SHEN W Z, YANG Y Y, et al. Relational graph attention network for aspect-based sentiment analysis[C]//Proceedings of 2020 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2020: 3229-3238.
33	LIN X V, SOCHER R, XIONG C M. Bridging textual and tabular data for cross-domain Text-to-SQL semantic parsing[C]//Proceedings of 2020 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2020: 4870-4888.
34	QIN B W, WANG L H, HUI B Y, et al. SUN: exploring intrinsic uncertainties in Text-to-SQL parsers[C]//Proceedings of the 29th International Conference on Computational Linguistics. Gyeongju, Republic of Korea: International Committee on Computational Linguistics, 2022: 298-5308.
35	WANG L H, QIN B W, HUI B Y, et al. Proton: probing schema linking information from pre-trained language models for Text-to-SQL parsing[C]//Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. New York, USA: ACM Press, 2022: 1889-1898.

[1]	WEI Mingkang, LI Jianan, HAN Lin, GAO Wei, ZHAO Rongcai, WANG Hongsheng. Support and Optimization of Multi-Granularity Quantization Framework for Deep Learning Compiler [J]. Computer Engineering, 2025, 51(5): 62-72.
[2]	ZHUANG Ziwei, ZHU Junguo. Vietnamese Text Error Detection Method for Multi-source Text [J]. Computer Engineering, 2025, 51(5): 93-102.
[3]	YAO Xun, WANG Haipeng, HU Xinrong, YANG Jie. Multi-view Contrastive Recommendation Algorithm Based on Adaptive Enhancement [J]. Computer Engineering, 2025, 51(5): 103-113.
[4]	LIU Wenjie, CHEN Liang, REN Zhijie. Few-shot Relation Reasoning Model Based on Graph Neural Network and Meta-Learning [J]. Computer Engineering, 2025, 51(5): 124-132.
[5]	ZHAO Yaoqian, TENG Qizhi, HE Xiaohai, SHUI Ai, CHEN Honggang. Lightweight Image Super-Resolution Reconstruction Based on Self-Attention Feature Distillation [J]. Computer Engineering, 2025, 51(5): 257-265.
[6]	LI Dandan, LI Zhi, ZHENG Long, ZHANG Li. Robust Reversible Watermarking Algorithm for Diffusion Tensor Images [J]. Computer Engineering, 2025, 51(5): 279-287.
[7]	LIU Yunxiang, LIANG Zhichao. A Highly Efficient Traffic Prediction Model for Continuous Time-series Graph Attention Networks [J]. Computer Engineering, 2025, 51(4): 350-359.
[8]	DU Chenyang, ZHANG Xueying, HUANG Lixia, LI Juan. Multi-Feature Speech Emotion Recognition Based on Improved Efficient Channel Attention Mechanism [J]. Computer Engineering, 2025, 51(4): 97-106.
[9]	JIANG Jieping, WANG Mingwen. Residual Behavior Recognition Model Based on Spatio-Temporal Shuffle Attention Mechanism [J]. Computer Engineering, 2025, 51(4): 119-128.
[10]	DAI Kangjia, XU Huiying, ZHU Xinzhong, LI Xiyu, HUANG Xiao, CHEN Guoqiang, ZHANG Zhixiong. YGL-SLAM: Point and Line Based Semantic SLAM System for Dynamic Scenes [J]. Computer Engineering, 2025, 51(3): 95-104.
[11]	LI Siyuan, ZHONG Xingyu, LI Kaiyin, XU Qingzhen. Strategy Teaching Research Based on Multilayer Graph Relationship and Reinforcement Learning [J]. Computer Engineering, 2025, 51(3): 122-130.
[12]	CHEN Depin, ZHAO Shen, JIAO Yiping, WANG Xiangxue, LÜ Hong, XU Jun. Graph Construction on Whole Image Slides Based on Attention and Learnable Threshold [J]. Computer Engineering, 2025, 51(3): 229-240.
[13]	HAN Peng, HUANG Yunzhi, REN Caiyue, CHENG Jingyi, XU Jun. Assessment of Neoadjuvant Chemotherapy Efficacy in Breast Cancer Using Dual-Branch Network with PET Imaging [J]. Computer Engineering, 2025, 51(3): 293-299.
[14]	HU Chaoju, GUO Fengyi. MODF Port State Detection Algorithm Based on Improved YOLOv7 [J]. Computer Engineering, 2025, 51(2): 78-85.
[15]	SUN Haomiao, LI Zongmin, XIAO Qian, SUN Wenjie, ZHANG Wenxin. AI-Curling: An On-Site Curling Analysis and Decision-Making Method [J]. Computer Engineering, 2025, 51(2): 102-110.

Please choose a citation manager

Content to export