Metric for evaluating mathematical models natural language words for machine translation

Muftakh Khakimov ()

International Journal of Innovative Research and Scientific Studies, 2025, vol. 8, issue 6, 2430-2447

Abstract: The purpose of this study is to describe and analyze a new metric for evaluating the effectiveness of mathematical models of natural language words based on an extensible input language in machine translation. A new SSM (Structural Semantic Metric) metric has been developed and researched, the methodology of which includes a description (requirement, calculation principle, analytical model, calculation algorithm) and group experiments on six types of mathematical models of words in three natural languages (Uzbek, English, Russian). The metric is implemented in Python, the software products at the input accept a mathematical model represented as a string of characters of an extensible input language, and at the output numerical values for the formula parameters and a general metric estimate. The result of the metric is a numerical value in the range of 0 and 1. A gradation of degrees of reflection of the structural and semantic relationships of mathematical models relative to the range of 0 and 1 is recommended. The experiments obtained prove the high semantic adequacy of mathematical models with reference structures of words in each of the natural languages, which can provide a very high degree (90% - 95%) of translation of words used in machine translation texts between the above languages in 6 directions. The results also highlight the possibility of expanding the model base with new mathematical models of natural language words using this methodology.

Keywords: English; Evaluation; Extensible input language; Machine translation; Mathematical model; Natural language; Russian language; Semantics; SSM metric; Terminal symbol; Uzbek language. (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijirss.com/index.php/ijirss/article/view/10125/2348 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aac:ijirss:v:8:y:2025:i:6:p:2430-2447:id:10125

Access Statistics for this article

International Journal of Innovative Research and Scientific Studies is currently edited by Natalie Jean

More articles in International Journal of Innovative Research and Scientific Studies from Innovative Research Publishing
Bibliographic data for series maintained by Natalie Jean ().