anarchy.website Toggle Dark Mode

Notes on Differential Equations

By Una Ada, April 27, 2018

Each specific note is marked with a page number in brackets, e.g. “[69]”. These page numbers refer to the textbook I had used for this course in the fall of 2015:

Nagle, R. Kent, Edward B. Saff, Arthur David Snyder. Fundamentals of Differential Equations 8th edition. Boston: Addison-Wesley, 2012.

Keywords and some definitions are marked in blue. MathJax is used for mathematics rendering, to help with readability there is a context menu that you can access by right-clicking on any embedded equation to set a “zoom trigger,” allowing you to enlarge the math by hovering, clicking, or double clicking. This feature is disabled by default.

Background

[4] There are ordinary differential equations and partial differential equations which differ in that the formal is with respect to (wrt) a single variable where as the latter may be of multiple variables or a single variable of a multivariate function. The general form is

and any differential equation that does not meet this form is considered to be nonlinear.

Solutions & Initial Value Problems

[6] The general form of a function where $x$ is the independent and $y$ is the dependent variable is

or

We then define some function $\phi(x)$ that when substituted for $y$ in either Eq.2 or 3 for all $x$ on some interval $I$ is called an explicit solution to the equation on $I$. That sounds really cool, but at the moment it doesn’t really mean anything.

[8] On the other hand, a relation $G(x,y)$ is said to be an implicit solution to Eq.3 on the interval $I$ if it defines one or more explicit solutions. This often defines multiple solutions because of the constant term that is created through integration.

[10] An initial value problem (IVP) for an nth-order differential equation (Eq.3) will ask you to find a solution to the interval $I$ that satisfies

where $x_0\in I$ and $y_0,y_1,\ldots,y_{n-1}$ are given constants. [11] To determine the existence and uniqueness of a solution we use Picard’s Theorem:

Consider the initial value problem $dy/dx=f(x,y)$ and $y(x_0)=y_0$, if $f$ and $\partial f/\partial y$ are continuous functions in some rectangle $R= \{ (x,y)\mid a\lt x\lt b, c\lt y\lt d \}$ that contains the point $(x_0,y_0)$, then the IVP has a unique solution $\phi(x)$ in some interval $x_0-\delta\lt x\lt x_0+\delta$, where $\delta\gt0$.

The Approximation Method of Euler

[23] The approximation method of Euler is super tedious to do by hand and so should be completely avoided unless you’re using it for numerical analysis / programming. To approximate $\phi(x)$ repeat the following for all steps $n$:

where $h$ is the step size.

Separable Equations

[38] A differential equation is separable when it can be expressed as

which you would solve as

and given some function $h(y)=1/g(y)$ this would be expressed as

Linear Equations

[36] The general equation for a linear first-order differential equation is

We find two scenarios in which the solution to Eq.10 is simple. First when $a_0(x)\equiv0$:

Second, the slightly less straightforward solution for when $a_0(x)=a_1’(x)$, which would mean that the LHS can be written as the derivative of a product:

[47] Of course, it is rarely so convenient as to be in this form on its own, so we need to find a way to rewrite the equation so it fits the criteria of the second solution. We do this by multiplying by some magical function $\mu(x)$. First step to achieving this is to write the equation in standard form:

where $P(x)=a_0(x)/a_1(x)$ and $Q(x)=b(x)/a_1(x)$. From here we can determine that we need $\mu(x)$ to be some function such that

is the derivative of the product $\mu(x)\cdot y$:

Obviously, there’s only one good solution to Eq.15c:

Somehow (since Eq.13 was created by dividing Eq.10 by $a_1(x)$ and $\mu(x)$ was calculated to be a function that when multiplied by Eq.13 would satisfy Eq.12, $\mu(x)$ can be substituted for $a_1(x)$ in Eq.12b) this allows us to find the general solution:

Exact Equations

[57] The differential form

is said to be exact in soem rectangle $R$ if there is a function $F(x,y)$ such that

and

for all $(x,y)$ in $R$. If the aforementioned form is exact then

is called an exact equation. Exactness can be tested by using the equation

[59] Method for solving differential equations that are exact:

  1. If $Mdx+Ndy=0$ is exact then $\partial F/\partial x=M$ which can be integrated wrt $x$ yielding

  2. Differentiate Eq.23 wrt $y$ finding

  3. Integrate $g’(y)$ to obtain $g(y)$ and substitute it into Eq.23 to find $F(x,y)$.
  4. The solution is given implicitly by

This can also be done using $N(x,y)$ and an integral wrt $y$ in step 1 instead of $M(x,y)$ and wrt $x$.

The Mass-Spring Oscillator

[154] The differential equation that describes the motion of a mass on a spring is

where $m\ge0$ is the mass of the mass, $b\ge0$ is the damping coefficient of the spring, and $k$ is the spring constant (stiffness) of the spring. When $b,F=0$ there is a solution in the form $y(t)=cos(\omega t)$, where $\omega$ is the frequency defined by $\sqrt{k/m}$.

Homogeneous Linear Equations: The General Solution

[158] The next few sections are all about second order differential equations, meaning that they are of the form

By looking at this we should be able to tell that the second derivative needs to be able to be expressed as a linear combination of the first and zeroth. This suggests we try to find solutions of the form $e^{rt}$. By substituting this in to the general form we find

Since $e^{rt}\neq0$ we can divide by it in Eq.28b. Eq.28c is called the auxiliary or characteristic equation.

[159] The trivial solution ($y(t)\equiv0$) is always a solution. If we have any pair of solutions $y_1$ and $y_2$ we can construct an infinite number of linear combinations that are also solutions (the proof of this is just typical superposition stuff, so trust me and/or try it out for yourself):

The two degrees of freedom ($c_1$ and $c_2$) imply that two consitions can be imposed, such as $y(0)$ and $y’(0)$ in an initial value problem. This will lead to systems of linear equations, so get ready for that.

[161] This can also be used to prove uniqueness. For any real numbers $a\neq0$, $b$, $c$, $t_0$, $Y_0$, and $Y_1$, there exists a unique solution to the initial value problem

which is valid for all $t$ in $(-\infty,\infty)$. A particularly important case is that od $Y_0=Y_1=0$, when $y(t)$ must be intically zero ($y(t)\equiv0$). Really important things happen if $y_1$ and $y_2$ are linearly dependent, then $y_2(t)=k\cdot y_1(t)$ and so

which is only one constant ($C$) and thus only one degree of freedom. As such we need linearly independent functions for $y_1$ and $y_2$, so definitely not just like constant multiples of each other. Then we’re going to need a way to tell if things are linearly independent or not.

[162] For any real numbers $a\neq0$, $b$, and $c$, if $y_1$ and $y_2$ are any two solutions to the differential equation $ay’‘+by’+cy=0$ in $(-\infty,\infty)$ and the equality

holds for any point $\tau$, then $y_1$ and $y_2$ are linearly dependent in $(-\infty,\infty)$. Fun fact, the LHS in Eq.32 is called the Wronskian of $y_1$ and $y_2$ at $\tau$, which is written like this:

Auxiliary Equations with Complex Roots

[167] When $b^2-4ac\lt0$ then the roots to the auxiliary equation are imaginary:

so we end up with $e^{rt}=e^{(\alpha+\beta i)t}=e^{\alpha t}e^{i\beta t}$. We know what $e^{\alpha t}$ is because it matches the form $e^{at}$ but what about the $e^{i\beta t}$ term? Well, we’re going to do some fun math:

This is known as Euler’s Formula because as mathematicians it is our job to suck Euler’s dick 24/7 and name everything he touched after him. Plugging this back into the auxiliary equation we get

which still has $i$ so it isn’t a “real” solution. So, imposing societal standards on it through some mathematical wizardry I’m not 100% certain about it we find the new form:

Nonhomogenous Equations: The Method of Undetermined Coefficients

Both the book and my class went through this whole bit they called “judicial guessing” which is just glorified trial and error to find some method by which solutions could be found. I’ll be skipping that because lmao fuck off.

To find a particular solution to the differential equation

where $m$ is a non-negative integer, we use the form

where $s$ is $0$ if $r$ is not a root, $1$ is $r$ is a simple root, and $2$ if $r$ is a double root of the auxiliary equation. To find a particular solution to the differential equation

for $\beta\neq0$, we use the form

where $s$ is $0$ if $\alpha+\beta i$ is not a root and $1$ if $\alpha+\beta i$ is a root of the auxiliary equation.

The Superposition Principle

[182] The superposition principle goes like: Let $y_1$ by the solution to

and $y_2$ be the solution to

Then, for any constants $k_1$ and $k_2$, the function $k_1y_1+k_2y_2$ is a solution to

[183] Onto the topic of existence and uniqueness: for any real numbers $a\neq0$, $b$, $c$, $t_0$, $Y_0$, and $Y_1$, suppose $y_p(t)$ is a particular solution in an interval $I$ where $t_0\in I$ and that $y_1$ and $y_2$ are linearly independent solutions to the homogeneous equation in $I$, then there exists a unique solution in $I$ to the initial value problem

and said solution is given by the form

for the appropriate choice of constant $c_1$ and $c_2$. [186] Now, the superposition principle and the method of undetermined coefficients make sweet, sweet love and birth a hybrid, which looks something like this:

where $P_m$ is a polynomial of degree $m$. The solution then is of the form

where $s$ is determined by the same method as previously. It could also look something like this:

where $P_m(t)$ and $Q_n(t)$ are polynomials of degree $m$ and $n$ respectively. The solution is then of the form

where $k$ is the larger of $m$ and $n$, and $s$ is defined by the conditions given for Eq.41.

Variable Coefficient Equations

[193] Solving an equation of the form

typically we divide both sides by $a_2$ to achieve the standard form

where $p(t)=a_1(t)/a_2(t)$, $q(t)=a_0(t)/a_2(t)$, $g(t)=f(t)/a_2(t)$, and $Y_0$ and $Y_1$ are some constants. Some theorem simply called “Theorem 5” gives a way to test for existence and uniqueness here:

Suppose $p(t)$, $q(t)$, and $g(t)$ are continuous on the interval $(a,b)$ which contains the point $t_0$, then for any choice of initial values $Y_0$ and $Y_1$ there exists a unique solution $y(t)$ on the same interval $(a,b)$ to the initial value problem.

[194] A linear second-order differential equation that can be expressed in the form

where $a$, $b$, and $c$ are constants, is called a Gauchy-Euler equation. To solve these we must acquire the characteristic equation, for this we simply substitute $t^r$ for $y$, which gives us

from which we should hopefully be able to derive the values $r_1$ and $r_2$ such that

If $r$ is in the form $\alpha\pm\beta i$ then we’ve got complex roots and the solutions will be of the form

and if $r$ is a double root the solutions will be of the form

[197] Assuming $y_1$ and $y_2$ are linearly independent, then we can declare the linear combinations $y_b=c_1y_1+c_2y_2$ and $y_p=v_1y_1+v_2y_2$. Assuming some interval $I$ where $p$, $q$, and $g$ are continuous, by substituting y_p$ we can find (I’m sparing the actual derivation of this because I don’t care):

where we specifically chose the first equation so we could avoid $v’’$ being involved in the equation. There’s a shortcut for finding these solutions that we weren’t allowed to use in class but this isn’t class so here it is:

and in case we need to find another solution:

Introduction: The Taylor Polynomial Series

[423] Quick review, this is a Taylor Series:

and a Taylor Polynomial is just the first $n$ terms of this.

Power Series and Analytic Functions

[427] A power series about the point $x_0$ is an expression of the form

I’m assuming you’ve taken at least Calculus II, so I’m just going to skip to more relevant information. [430] If the series has a positive radius of convergence $\rho$, then $f$ is differentiable in the interval $|x-x_0|\le\rho$ and termwise differentiation gives us

and termwise integration would give us

[431] For reference, the index of the summation is a dummy variable with no bearing outside of the context of the summation, so we can shift it around by constants and maybe variables if you know what you’re doing to clean up the summation a bit.

Power Series Solutions to Linear Differential Equations

[437] A point $x_0$ is called an ordinary point of the equation if both $p=a_1/a_2$ and $q=a_0/a_2$ are analytic at $x_0$. Otherwise we would call it a singular point. We’re not too concerned about the exact definition of analytic here, so we’ll just use defined and continuous.

[439] There’s this thing called a recurrence relation. By plugging in the generic power series to the differential equation equal to $\sum0\cdot x^n$ (the series equivalent to just $0$) and shifting all the series to have the generic term $x^n$, you’ll get some equation of $a_n$, $a_{n+1}$, and/or $a_{n+2}$, which will allow you to find some relation between $a_{n+2}$ or $a_{n+1}$ and $a_n$. By solving for several terms using this relation you can find some pattern by which to define $a_n$, a solution that can be plugged into $y=\sum a_nx^n$ to find the actual solution.

[449] When your coefficients are functions, you basically just multiplying the function out termwise and you can simplify from there or whatever.

Definition of the Laplace Transform

[353] The Laplace Transform of $f$ is the function $F$ defined as

Sometimes we’ll have to solve these by hand, over odd intervals, for weird functions, especially at first. Eventually we can just use a Laplace Transform Table (there isn’t one on this page, so just Google for it, I suppose).

[355] This transform is linear, so we can say that

and

[356] The Laplace Transform of $f$ exists when $f$ is piecewise continuous on $[0,\infty)$. The transform is generally pretty useful in simplifying some differential equations into easier algebraic equations.

Properties of the Laplace Transform

[361] A translation in $s$ looks like

The Laplace Transform for the derivative of $f$ (assuming $f$ is of exponential order $a$) for the first and nnth derivatives:

For an equation of form $t^nf(t)$ we can use the formula

[367] The Inverse Laplace Transform is the opposite of the Laplace Transform such that when $\mathcal{L}\{f\}=F$ there exists the inverse $\mathcal{L}^{-1} \{F\}=f$. This is also linear. Keep in mind the method of partial fractions for this. [376] For solving IVPs with the Laplace Transform, apply the transform to both sides of the equation, solve for $Y(s)$ ($\mathcal{L}\{y(t)\}=Y(s)$), then apply the inverse transform. Also remember to use Eq.69 (nice) for a lot of problems.