Life expectancies of the human male and female have been increasing significantly since the turn of the 20th century, and the trend is expected to continue. The study of elderly mortality has thus become a favorite research topic. However, because there were not enough elderly data before 1990, there is still no conclusion about which mortality model is appropriate for describing elderly mortality. In this study, we modify the regular discount sequence in the Bandit Problem and use it to describe elderly mortality. We found that many frequently used mortality models, such as the Gompertz Law, and famous mortality assumptions (Uniform Distribution of Death, Constant Force, and Hyperbolic assumption) all satisfy the requirement of a regular discount sequence.We also use empirical data from the HMD (Human Mortality Database from University of California, Berkeley), including data from Japan, the US, and Taiwan, to evaluate the proposed approach. The discount sequences of life expectancy and surviving number ratio do satisfy the regularity condition. In addition, we use the Brownian Motion Stochastic Differential Equation to model the discount sequence. Using this model, we predict the future mortality rates and life expectancy. The simulation study shows some promising results.