# A new class of activation functions. Some related problems and applications

## DOI:

https://doi.org/10.11145/j.biomath.2020.05.033## Keywords:

two-parameter bathtub hazard distribution, ''saturation'' by, new activation function and family of new recurrence generated functions, Topp-Leone-G-Family with baseline ''deterministic-type'' cdf (NTLG-DT), Topp-Leone-G-Family## Abstract

The cumulative distribution function (cdf) of the discrete two--parameter bathtub hazard distribution has important role in the fields of population dynamics, reliability analysis and life testing experiments.В Also of interest to the specialists is the task of approximating the Heaviside function by new (cdf) in Hausdorff sense.В We define new activation function and family of new recurrence generated functions and study the ''saturation'' by these families.В In this paper we analyze some intrinsic properties of the new Topp-Leone-G-Family with baseline ''deterministic-type'' (cdf) - (NTLG-DT).В Some numerical examples with real data from Biostatistics, Population dynamics and Signal theory, illustrating our results are given.В It is shown that the study of the two characteristics - "confidential curves" and ''super saturation'' is a must when choosing the right model.В Some related problems are discussed, as an example to the Approximation Theory.

## References

R. Bantan, F. Jamal, Ch. Chesneau, M. Elgarhy, A New Power Topp-Leone Generated Family of Distributions with Applications, Entropy, 21, 12, 1177, 2019.

A. Sarhan, Bayesian analysis of the discrete two--parameter bathtub hazard distribution, J. of Math. Sci. and Modelling, 2, 3, 183--192, 2019.

B. Sendov, Hausdorff Approximations, Kluwer, Boston, 1990.

P. E. Oguntunde, M. A. Khaleel, H. I. Okagbue, O. A. Odetunmibi, The Topp-Leone Lomax (TLLo) Distribution with Applications to Airbone Communication Transceiver Dataset, Wireless Personal Communications, 109, 349--360, 2019.

A. Afify, A. Abdellatif, The extended Burr XII distribution: properties and applications, J. of Nonlinear Sci. and Appl., 13, 133--146, 2020.

A. Sharma, S. Sharma, A. Mittal, S. Naik, Statistical optimization of growth media for Paecilomyces lilacinus 6029 using non--edible oil cakes, Ann. of Microbiology, 64, 515--520, 2014.

S. Sarat, A. Terzis, HiNRG Technical Report: 01-10-2007 Measuring the Storm Worm Network, 2007.

B. Gompertz, On the nature of the function expressive of the law of human mortality, and on a new mode of determining the 62

value of life contingencies}, Philos Trans R Soc London, 115, 513-вЂ“585, 1825.

S. Markov, Reaction networks reveal new links between Gompertz and Verhulst growth functions, Biomath, 8, 1, 2019.

L. Rogers-Bennett, D. W. Rogers, A Two-Step Growth Curve: Approach to the von Bertalanffy and Gompertz

Equations, Advances in Pure Mathematics, 6, 321-вЂ“330, 2016.

K. Tjrve, E. Tjrve, The use of Gompertz models in growth analyses, and new Gompertz-model approach: An addition

to the Unified-Richards family, PLoS ONE, 12, 6, 2017.

M. Tahir, G. Cordeiro, Compounding of distributions: A survey and new generalized classes, J. of Stat. Distr. and Appl., 3, 13, 1--35, 2016.

D. Satoh, Property of logistic data exposed with Gompertz model and resistance to noise in actual data, Japan J. of Ind. and Appl. Math., 2019.

S. Yamada, A stochastic software reliability growth model with Gompertz curve, Trans. IPSJ, 33, 964--969, 1992. (in Japanese)

D. Satoh, S. Yamada, Discrete equations and software reliability growth models, in: Proc. 12th Int. Symp. on Software Reliab. and Eng., 176--184, 2001.

H. Okamura, T. Dohi, S. Osaki, EM algorithms for logistic software reliability models, In: Proc. 7th IASTED Int. Conf. on Software Eng., 263--268, 2004.

S. Yamada, M. Ohba, S. Osaki, S--shaped reliability growth modeling for software error detection, IEEE Trans, Reliab., R--32, 475--478, 1983.

M. Xie, Software Reliability Modelling}, World Scientific, Singapore, 1991.

H. Pham, Software Reliability, Springer, Singapore, 2000.

N. Kyurkchiev, On a sigmoidal growth function generated by reaction networks. Some extensions and applications, Communications in Applied Analysis, 23, 3, 383--400, 2019.

D. Costarelli, R. Spigler, Constructive Approximation by Superposition of Sigmoidal Functions}, Anal. Theory Appl., 29, 169--196, 2013.

D. Costarelli, G. Vinti, Pointwise and uniform approximation by multivariate neural network operators of the max-product type, Neural Networks, 81, 81--90, 2016.

N. Guliyev, V. Ismailov, A single hidden layer feedforward network with only one neuron in the hidden layer san approximate any univariate function, Neural Computation, 28, 1289--1304, 2016.

N. Kyurkchiev, S. Markov, On the Hausdorff distance between the Heaviside step function and Verhulst logistic function, J. Math. Chem., 54, 1, 109--119, 2016.

N. Kyurkchiev, S. Markov, Sigmoid functions: Some Approximation and Modelling Aspects, LAP LAMBERT Academic Publishing, Saarbrucken, 2015, ISBN 978-3-659-76045-7.

N. Kyurkchiev, A. Iliev, S. Markov, Some Techniques for Recurrence Generating of Activation Functions: Some Modeling and Approximation Aspects, LAP LAMBERT Academic Publishing, 2017, ISBN: 978-3-330-33143-3.

A. Iliev, N. Kyurkchiev, S. Markov, A Note on the New Activation Function of Gompertz Type, Biomath Communications, 4, 2, 20 pp., 2017.

R. Anguelov, M. Borisov, A. Iliev, N. Kyurkchiev, S. Markov, On the chemical meaning of some growth models possessing Gompertzian-type property, Math. Meth. Appl. Sci., 1--12, 2017.

R. Anguelov, N. Kyurkchiev, S. Markov, Some properties of the Blumberg's hyper-log-logistic curve, Biomath, 7, 1, 8 pp., 2018.

S. Markov, A. Iliev, A. Rahnev, N. Kyurkchiev, On the exponential--generalized extended Compertz cumulative sigmoid, International Journal of Pure and Applied Mathematics, 120, 4, 555--562, 2018.

N. Pavlov, A. Iliev, A. Rahnev, N. Kyurkchiev, Some software reliability models: Approximation and modeling aspects, LAP LAMBERT Academic Publishing, 2018, ISBN: 978-613-9-82805-0.

A. Iliev, N. Kyurkchiev, A. Rahnev, T. Terzieva, Some models in the theory of computer viruses propagation, LAP LAMBERT Academic Publishing, 2019, ISBN: 978-620-0-00826-8.

A. Iliev, N. Kyurkchiev, S. Markov, On the approximation of the cut and step functions by logistic and Gompertz functions, Biomath, 4, 2--13, 2015.

N. Kyurkchiev, A. Iliev, A. Rahnev, {it A new class of activation functions based on the correcting amendments of Gompertz-Makeham type}, Dynamic Systems and Applications, 28, 2, 243--257, 2019.

N. Kyurkchiev, A. Iliev, A. Rahnev, Some Families of Sigmoid Functions: Applications to Growth Theory, LAP LAMBERT Academic Publishing, 2019, ISBN: 978-613-9-45608-6.

N. Pavlov, A. Iliev, A. Rahnev, N. Kyurkchiev, Nontrivial Models in Debugging Theory (Part 2), LAP LAMBERT Academic Publishing, 2018, ISBN: 978-613-9-87794-2.

O. Rahneva, T. Terzieva, A. Golev, Investigations on the Zubair-family with baseline Ghosh-Bourguignon's extended Burr XII cumulative sigmoid. Some applications, Neural, Parallel, and Scientific Computations, 27, 1, 11--22, 2019.

A. Malinova, O. Rahneva, A. Golev, V. Kyurkchiev, Investigations on the Odd-Burr-III-Weibull cumulative sigmoid. Some applications, Neural, Parallel, and Scientific Computations, 27, 1, 35--44, 2019.

N. Kyurkchiev, Investigations on a hyper-logistic model. Some applications, Dynamic Systems and Applications, 28, 2, 351--369, 2019.

S. Markov, A. Iliev, A. Rahnev, N. Kyurkchiev, A note on the n-stage growth model. Overview, Biomath Communications, 5, 2, 79--100, 2018.

E. Angelova, A. Golev, T. Terzieva, O. Rahneva, A study on a hyper-power-logistic model. Some applications, Neural, Parallel, and Scientific Computations, 27, 1, 45--57, 2019.

N. Kyurkchiev, A. Iliev, A. Rahnev, On a special choice of nutrient supply for cell growth in a continuous bioreactor. Some modeling and approximation aspects, Dynamic Systems and Applications, 28, 3, 587--606, 2019.

N. Kyurkchiev, A. Iliev, Extension of Gompertz-type equation in modern science. 240 Anniversary of the birth of B. Gompertz, LAP LAMBERT Academic Publishing, 2018, ISBN: 978-613-9-90569-0.

N. Kyurkchiev, A. Iliev, A. Rahnev, T. Terzieva, Properties of a power Topp--Leone G--family with baseline Gompertz cumulative distribution function, 2020. (in print)

B. I. Yun, A Neural Network Approximation Based on a Parametric Sigmoidal Function, Mathematics, 7, 262, 2019.

N. Kyurkchiev, Comments on the Yun's algebraic activation function. Some extensions in the trigonometric case, Dynamic Systems and Applications, 28, 3, 533--543, 2019.

N. Kyurkchiev, A. Andreev, Approximation and Antenna and Filters synthesis. Some Moduli in Programming Environment MATHEMATICA, LAP LAMBERT Academic Publishing, Saarbrucken, 2014, ISBN 978-3-659-53322-8.

Bl. Sendov, H. Schinev, N. Kjurkchiev, Hausdorff-synthesis of aerial grids in scanning the directive diagram, Electropromishlenost i Priboroostroene, 16, 5, 203--205, 1981. (in Bulgarian)

N. Kyurkchiev, Synthesis of slot aerial grids with Hausdorff type directive patterns, PhD Thesis, Department of Radio-Electronics, VMEI, Sofia, 1979. (in Bulgarian)

N. Kyurkchiev, Bl. Sendov, Approximation of a class of functions by algebraic polynomials with respect to Hausdorff distance, Ann. Univ. Sofia, Fac. Math., 67, 573--579, 1975. (in Bulgarian)

N. Kyurkchiev, S. Markov, On the numerical approximation of the "cross" set, Ann. Univ. Sofia, Fac. Math., 66, 19--25, 1974. (in Bulgarian)

J. Peters, Foundations of Computer Vision: Computational Geometry, Visual Image Structures and Object Shape Detection, Springer, Cham, 2017.

N. Kyurkchiev, G. Nikolov, Comments on some new classes of sigmoidal and activation functions. Applications, Dynamic Systems and Applications, 28, 4, 789--808, 2019.

N. Kyurkchiev, S. Markov, On a logistic differential model. Some applications, Biomath Communications, 6, 1, 34--50, 2019.

N. Kyurkchiev, A. Iliev, A. Rahnev, A special choice of nutrient supply for cell growth in logistic differential model. Some applications, Conference Proceedings of AIP, 2019.

N. Kyurkchiev, A. Iliev, A. Golev, A. Rahnev, On a Special Choice of Nutrient Supply with Marshall-Olkin Correction. Some Applications, Communications in Applied Analysis, 23, 3, 401--419, 2019.

Bl. Sendov, R. Maleev, S. Markov, S. Tashev, Mathematics for Biologists, University Publishing House "St. Kliment Ohridski", Sofia, 1991.

E. Bohl, Mathematik in der Biologie, 4., vollstandig uberarbeitete und erweiterte Auflage, Springer, Berlin, 2006.

## Downloads

## Published

## Issue

## Section

## License

The journal Biomath is an open access journal. All published articles are immeditely available online and the respective DOI link activated. All articles can be access for free and no reader registration of any sort is required. No fees are charged to authors for article submission or processing. Online publications are funded through volunteer work, donations and grants.

Authors who publish with this journal agree to the following terms:

- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License 4.0 that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).