Autonomous Databases: Leveraging Machine Learning and Neural Networks for Predictive Query Optimization, Self-Tuning, and Index Optimization in Multi-RDBMS Systems

Authors

  • Santosh Jaini Independent Researcher

DOI:

https://doi.org/10.36676/jrps.v13.i2.1600

Keywords:

Autonomous Databases, Machine Learning, Neural Networks

Abstract

Autonomous databases are the new fad in modern database systems. The database systems are managed by machine learning and neural networks for query prediction, self-tuning, and self-indexing. These systems decrease intervention in multi-relational database management systems (multi-RDBMS). This paper analyses the relevance of ML and NN in optimizing the queries and automating the working of databases. Either simulation results of the tested benchmark queries or real-time use cases show the extent of the query processing speed increase and its accuracy. However, problems like implementing these technologies into current structures and dealing with high-velocity data persist. The proposed solutions are using graph neural networks to solve scalability problems. In conclusion, this research enshrines the prospects for AI autonomous databases to improve performance in multi-RDBMS architecture.

References

Ding, B., Das, S., Marcus, R., Wu, W., Chaudhuri, S., & Narasayya, V. R. (2019, June). Ai meets ai: Leveraging query executions to improve index recommendations. In Proceedings of the 2019 International Conference on Management of Data (pp. 1241-1258). https://pages.cs.wisc.edu/~wentaowu/papers/sigmod19-auto-indexing.pdf

Gadepally, V., Goodwin, J., Kepner, J., Reuther, A., Reynolds, H., Samsi, S., ... & Martinez, D. (2019). Ai enabling technologies: A survey. arXiv preprint arXiv:1905.03592. https://arxiv.org/pdf/1905.03592

Heitz, J., & Stockinger, K. (2019). Join query optimization with deep reinforcement learning algorithms. arXiv preprint arXiv:1911.11689. https://arxiv.org/pdf/1911.11689

Jindal, A., Patel, H., Roy, A., Qiao, S., Yin, Z., Sen, R., & Krishnan, S. (2019, November). Peregrine: Workload optimization for cloud query engines. In Proceedings of the ACM Symposium on Cloud Computing (pp. 416-427). http://alekh.org/papers/241-jindal.pdf

Kang, D., Bailis, P., & Zaharia, M. (2018). Blazeit: Optimizing declarative aggre https://arxiv.org/pdf/1703.02529 https://arxiv.org/pdf/1703.02529

Krebs, S., Duraisamy, B., & Flohr, F. (2017, October). A survey on leveraging deep neural networks for object tracking. In 2017 IEEE 20th international conference on Intelligent Transportation Systems (ITSC) (pp. 411-418). IEEE. https://pdfs.semanticscholar.org/6433/37c78c920dce1f3f4ee06a88e3db9f0348b1.pdf

Li, F. (2019). Cloud-native database systems at Alibaba: Opportunities and challenges. Proceedings of the VLDB Endowment, 12(12), 2263-2272. https://vldb.org/pvldb/vol12/p2263-li.pdf

Pavlo, A., Butrovich, M., Joshi, A., Ma, L., Menon, P., Van Aken, D., ... & Salakhutdinov, R. (2019). External vs. internal: an essay on machine learning agents for autonomous database management systems. IEEE bulletin, 42(2). https://par.nsf.gov/servlets/purl/10128901

Qolomany, B., Al-Fuqaha, A., Gupta, A., Benhaddou, D., Alwajidi, S., Qadir, J., & Fong, A. C. (2019). Leveraging machine learning and big data for smart buildings: A comprehensive survey. IEEE access, 7, 90316-90356. https://ieeexplore.ieee.org/iel7/6287639/8600701/08754678.pdf

Katikireddi, P. M., Singirikonda, P., & Vasa, Y. (2021). Revolutionizing DEVOPS with Quantum Computing: Accelerating CI/CD pipelines through Advanced Computational Techniques. Innovative Research Thoughts, 7(2), 97–103. https://doi.org/10.36676/irt.v7.i2.1482

Vasa, Y., & Mallreddy, S. R. (2022). Biotechnological Approaches To Software Health: Applying Bioinformatics And Machine Learning To Predict And Mitigate System Failures. Natural Volatiles & Essential Oils, 9(1), 13645–13652. https://doi.org/https://doi.org/10.53555/nveo.v9i2.5764

Mallreddy, S. R., & Vasa, Y. (2022). Autonomous Systems In Software Engineering: Reducing Human Error In Continuous Deployment Through Robotics And AI. NVEO - Natural Volatiles & Essential Oils, 9(1), 13653–13660. https://doi.org/https://doi.org/10.53555/nveo.v11i01.5765

Vasa, Y., Jaini, S., & Singirikonda, P. (2021). Design Scalable Data Pipelines For Ai Applications. NVEO - Natural Volatiles & Essential Oils, 8(1), 215–221. https://doi.org/https://doi.org/10.53555/nveo.v8i1.5772

Singirikonda, P., Jaini, S., & Vasa, Y. (2021). Develop Solutions To Detect And Mitigate Data Quality Issues In ML Models. NVEO - Natural Volatiles & Essential Oils, 8(4), 16968–16973. https://doi.org/https://doi.org/10.53555/nveo.v8i4.5771

Vasa, Y. (2021). Develop Explainable AI (XAI) Solutions For Data Engineers. NVEO - Natural Volatiles & Essential Oils, 8(3), 425–432. https://doi.org/https://doi.org/10.53555/nveo.v8i3.5769

Vasa, Y. (2021b). Quantum Information Technologies in cybersecurity: Developing unbreakable encryption for continuous integration environments. International Journal for Research Publication and Seminar, 12(2), 482–490. https://doi.org/10.36676/jrps.v12.i2.1539

Vasa, Y. (2021b). Robustness and adversarial attacks on generative models. International Journal for Research Publication and Seminar, 12(3), 462–471. https://doi.org/10.36676/jrps.v12.i3.1537

Nunnagupala, L. S. C. ., Mallreddy, S. R., & Padamati, J. R. . (2022). Achieving PCI Compliance with CRM Systems. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 13(1), 529–535.

Jangampeta, S., Mallreddy, S.R., & Padamati, J.R. (2021). Anomaly Detection for Data Security in SIEM: Identifying Malicious Activity in Security Logs and User Sessions. 10(12), 295-298

Jangampeta, S., Mallreddy, S. R., & Padamati, J. R. (2021). Data Security: Safeguarding the Digital Lifeline in an Era of Growing Threats. International Journal for Innovative Engineering and Management Research, 10(4), 630-632.

Sukender Reddy Mallreddy(2020).Cloud Data Security: Identifying Challenges and Implementing Solutions.JournalforEducators,TeachersandTrainers,Vol.11(1).96 -102.

Naresh Babu Kilaru. (2021). AUTOMATE DATA SCIENCE WORKFLOWS USING DATA ENGINEERING TECHNIQUES. International Journal for Research Publication and Seminar, 12(3), 521–530. https://doi.org/10.36676/jrps.v12.i3.1543

Kilaru, N. B., & Cheemakurthi, S. K. M. (2021). Techniques For Feature Engineering To Improve Ml Model Accuracy. NVEO-NATURAL VOLATILES & ESSENTIAL OILS Journal| NVEO, 194-200.

Kilaru, N. B., Cheemakurthi, S. K. M., & Gunnam, V. (2021). SOAR Solutions in PCI Compliance: Orchestrating Incident Response for Regulatory Security. ESP Journal of Engineering & Technology Advancements, 1(2), 78–84. https://doi.org/10.56472/25832646/ESP-V1I2P111

Kilaru, N. B., Cheemakurthi, S. K. M., & Gunnam, V. (n.d.). Advanced Anomaly Detection In Banking: Detecting Emerging Threats Using Siem. International Journal of Computer Science and Mechatronics, 7(4), 28–33.

Downloads

Published

30-06-2022

How to Cite

Santosh Jaini. (2022). Autonomous Databases: Leveraging Machine Learning and Neural Networks for Predictive Query Optimization, Self-Tuning, and Index Optimization in Multi-RDBMS Systems. International Journal for Research Publication and Seminar, 13(2), 378–386. https://doi.org/10.36676/jrps.v13.i2.1600