A numerical reservoir simulator that uses a finite volume spatial discretization and two time discretization schemes is developed and tested. First and second order derivatives for the numerical simulator are derived, using an adjoint based approach. The adjoint and derivatives are validated in the context of the time discretization schemes, using varying time step sizes, and compared for accuracy. Two optimization algorithms are developed and used in combination to solve a numerical reservoir optimization problem. Numerical results are presented and discussed.