Dynamic Programming

Background

Dynamic programming is a mathematical approach and method used to solve problems that involve making sequential decisions over time. In economics, it particularly serves in the domain of intertemporal optimization problems where current decisions impact future outcomes.

Historical Context

Dynamic programming was introduced by Richard Bellman in the 1950s. His pioneering work laid the foundation for the extensive use of dynamic programming across various fields, including economics, engineering, and operations research.

Definitions and Concepts

Dynamic programming involves breaking down a large complex problem into simpler sub-problems. It leverages the idea that at each point in time, the maximized pay-off for the decision-maker can be expressed as the maximized value of the sum of the current pay-off and the discounted future pay-offs. This recursive approach makes the computation and optimization more manageable.

Major Analytical Frameworks

Classical Economics

• Traditional resource allocation and production decisions can sometimes be framed dynamically, although classical methodology often focuses on static analysis.

Neoclassical Economics

• In neoclassical models, dynamic programming is often used to solve consumer utility maximization and firm profit maximization problems over time.

Keynesian Economist

• Keynesian economics primarily discusses short-term adjustments rather than long-term optimization, yet some modern extensions may employ dynamic programming for macroeconomic policy analysis.

Marxian Economics

• Marxian analysis typically involves qualitative assessment over quantitative optimization, although some contemporary Marxian economists might apply dynamic programming to study capitalist dynamics over time.

Institutional Economics

• Examining the evolution of rules and norms could incorporate dynamic programming to understand institutional change processes.

Behavioral Economics

• While focus is often on psychological factors, dynamic models can describe how behaviors and decision-making processes evolve over time.

Post-Keynesian Economics

• Incorporates dynamic models to study how economic policies unfold over time, integrating elements of uncertainty and historical context.

Austrian Economics

• Dynamic considerations in entrepreneurial decision-making and market processes can be modeled using dynamic programming.

Development Economics

• Long-term development planning, investments in human capital, and other areas use dynamic programming for optimal policy paths.

Monetarism

• Applying dynamic programming to understand impacts of monetary policy decisions on long-term economic stability.

Comparative Analysis

Different economic schools employ dynamic programming to various extents. While neoclassical economics has integrated it deeply into its analysis, schools like classical economics and Austrian economics engage less quantitatively, focusing predominantly on other analytical methods.

Case Studies

1. Intertemporal Consumption and Savings Decisions: Dynamic programming used to model households making savings and consumption decisions over their lifecycle.
2. Investment Decisions: Firms utilizing dynamic programming to decide on optimal investment projects considering future returns and costs.

Suggested Books for Further Studies

1. Dynamic Programming and Optimal Control by Dimitri P. Bertsekas
2. Dynamic Economics: Quantitative Methods and Applications by Jerome Adda and Russell Cooper
3. Applied Dynamic Programming for Optimization of Dynamical Systems by Rush D. Robinett III and David G. Wilson

Related Terms with Definitions

• Optimization: The process of making something as effective or functional as possible given certain constraints and objectives.
• Intertemporal Optimization: An optimization process that involves decisions made at different points in time, affecting present and future outcomes.
• Discounted Pay-offs: A method of valuing future pay-offs by applying a discount rate to account for the time value of money.

Quiz