<p>This study rigorously delves into some analytic properties of an improved activation function (referred as <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="13398_2025_1710_Article_IEq1.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="62" /> </InlineMediaObject> <EquationSource Format="TEX">\({ flx}\tanh \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mrow> <mi mathvariant="italic">flx</mi> </mrow> <mo>tanh</mo> </mrow> </math></EquationSource> </InlineEquation>). The determined results appear as a generalization of some results known in the literature. The <InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="13398_2025_1710_Article_IEq2.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="62" /> </InlineMediaObject> <EquationSource Format="TEX">\({ flx}\tanh \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mrow> <mi mathvariant="italic">flx</mi> </mrow> <mo>tanh</mo> </mrow> </math></EquationSource> </InlineEquation> is created by taking into account symmetry property, parameterizability, and deformability of the classical <InlineEquation ID="IEq3"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="13398_2025_1710_Article_IEq3.gif" Format="GIF" Height="14" Rendition="HTML" Resolution="72" Type="Linedraw" Width="33" /> </InlineMediaObject> <EquationSource Format="TEX">\(\tanh \)</EquationSource> <EquationSource Format="MATHML"><math> <mo>tanh</mo> </math></EquationSource> </InlineEquation> function. Under the regime of certain parameters, we examine the behaviours of <InlineEquation ID="IEq4"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="13398_2025_1710_Article_IEq4.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="62" /> </InlineMediaObject> <EquationSource Format="TEX">\({ flx}\tanh \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mrow> <mi mathvariant="italic">flx</mi> </mrow> <mo>tanh</mo> </mrow> </math></EquationSource> </InlineEquation>. Moreover, these dynamic properties of the function <InlineEquation ID="IEq5"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="13398_2025_1710_Article_IEq5.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="62" /> </InlineMediaObject> <EquationSource Format="TEX">\({ flx}\tanh \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mrow> <mi mathvariant="italic">flx</mi> </mrow> <mo>tanh</mo> </mrow> </math></EquationSource> </InlineEquation> yields promising results as an activation function in deep neural networks. We utilize the PyTorch library running on Python 3.9 to evaluate the performance of our activation function. Additionally, we aim to encourage the readers to improve their computer programming language skills by making the Python 3.9 codes available on GitHub.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Some mathematical properties of flexible hyperbolic tangent activation function with application to deep neural networks

  • Seda Karateke

摘要

This study rigorously delves into some analytic properties of an improved activation function (referred as \({ flx}\tanh \) flx tanh ). The determined results appear as a generalization of some results known in the literature. The \({ flx}\tanh \) flx tanh is created by taking into account symmetry property, parameterizability, and deformability of the classical \(\tanh \) tanh function. Under the regime of certain parameters, we examine the behaviours of \({ flx}\tanh \) flx tanh . Moreover, these dynamic properties of the function \({ flx}\tanh \) flx tanh yields promising results as an activation function in deep neural networks. We utilize the PyTorch library running on Python 3.9 to evaluate the performance of our activation function. Additionally, we aim to encourage the readers to improve their computer programming language skills by making the Python 3.9 codes available on GitHub.