derivative of inverse matrix by itself
$begingroup$
Let $A$ be a matrix, supposedly $ktimes k$ matrix.
I know that
$$frac{partial A^{-1}}{partial A} = -A^{-2} $$
I do not know how I am supposed to obtain the following results using this fact. I want to know the step of
$$frac{partial a^top A^{-1} b}{partial A} = -(A^top)^{-1}ab^top (A^top)^{-1} $$
Also, I want to know the solution to
$$frac{partial (A^top)^{-1}ab^top (A^top)^{-1} }{partial A} = ? $$
matrix-calculus
$endgroup$
add a comment |
$begingroup$
Let $A$ be a matrix, supposedly $ktimes k$ matrix.
I know that
$$frac{partial A^{-1}}{partial A} = -A^{-2} $$
I do not know how I am supposed to obtain the following results using this fact. I want to know the step of
$$frac{partial a^top A^{-1} b}{partial A} = -(A^top)^{-1}ab^top (A^top)^{-1} $$
Also, I want to know the solution to
$$frac{partial (A^top)^{-1}ab^top (A^top)^{-1} }{partial A} = ? $$
matrix-calculus
$endgroup$
2
$begingroup$
First formula; is not it $-A^ {-2}$ ?
$endgroup$
– Damien
Dec 3 '18 at 6:36
$begingroup$
@Damien Yes, i editted
$endgroup$
– user1292919
Dec 3 '18 at 15:26
$begingroup$
Do you just know the first identity you stated or also how to obtain it? Because if so, you should be able to figure out the other identities too. However, please let us know what your attempts are.
$endgroup$
– James
Dec 3 '18 at 15:41
add a comment |
$begingroup$
Let $A$ be a matrix, supposedly $ktimes k$ matrix.
I know that
$$frac{partial A^{-1}}{partial A} = -A^{-2} $$
I do not know how I am supposed to obtain the following results using this fact. I want to know the step of
$$frac{partial a^top A^{-1} b}{partial A} = -(A^top)^{-1}ab^top (A^top)^{-1} $$
Also, I want to know the solution to
$$frac{partial (A^top)^{-1}ab^top (A^top)^{-1} }{partial A} = ? $$
matrix-calculus
$endgroup$
Let $A$ be a matrix, supposedly $ktimes k$ matrix.
I know that
$$frac{partial A^{-1}}{partial A} = -A^{-2} $$
I do not know how I am supposed to obtain the following results using this fact. I want to know the step of
$$frac{partial a^top A^{-1} b}{partial A} = -(A^top)^{-1}ab^top (A^top)^{-1} $$
Also, I want to know the solution to
$$frac{partial (A^top)^{-1}ab^top (A^top)^{-1} }{partial A} = ? $$
matrix-calculus
matrix-calculus
edited Dec 3 '18 at 15:26
user1292919
asked Dec 3 '18 at 5:42
user1292919user1292919
760512
760512
2
$begingroup$
First formula; is not it $-A^ {-2}$ ?
$endgroup$
– Damien
Dec 3 '18 at 6:36
$begingroup$
@Damien Yes, i editted
$endgroup$
– user1292919
Dec 3 '18 at 15:26
$begingroup$
Do you just know the first identity you stated or also how to obtain it? Because if so, you should be able to figure out the other identities too. However, please let us know what your attempts are.
$endgroup$
– James
Dec 3 '18 at 15:41
add a comment |
2
$begingroup$
First formula; is not it $-A^ {-2}$ ?
$endgroup$
– Damien
Dec 3 '18 at 6:36
$begingroup$
@Damien Yes, i editted
$endgroup$
– user1292919
Dec 3 '18 at 15:26
$begingroup$
Do you just know the first identity you stated or also how to obtain it? Because if so, you should be able to figure out the other identities too. However, please let us know what your attempts are.
$endgroup$
– James
Dec 3 '18 at 15:41
2
2
$begingroup$
First formula; is not it $-A^ {-2}$ ?
$endgroup$
– Damien
Dec 3 '18 at 6:36
$begingroup$
First formula; is not it $-A^ {-2}$ ?
$endgroup$
– Damien
Dec 3 '18 at 6:36
$begingroup$
@Damien Yes, i editted
$endgroup$
– user1292919
Dec 3 '18 at 15:26
$begingroup$
@Damien Yes, i editted
$endgroup$
– user1292919
Dec 3 '18 at 15:26
$begingroup$
Do you just know the first identity you stated or also how to obtain it? Because if so, you should be able to figure out the other identities too. However, please let us know what your attempts are.
$endgroup$
– James
Dec 3 '18 at 15:41
$begingroup$
Do you just know the first identity you stated or also how to obtain it? Because if so, you should be able to figure out the other identities too. However, please let us know what your attempts are.
$endgroup$
– James
Dec 3 '18 at 15:41
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Start with the defining equation for the matrix inverse and find its differential.
$$eqalign{
I &= A^{-1}A cr
0 &= dA^{-1},A + A^{-1},dA cr
0 &= dA^{-1},A + A^{-1},dA,A^{-1} cr
dA^{-1} &= -A^{-1},dA,A^{-1} cr
}$$
Next note the gradient of a matrix with respect to itself.
$$
{mathcal H}_{ijkl} = frac{partial A_{ij}}{partial A_{kl}} = delta_{ik}delta_{jl}
$$
Note that ${mathcal H}$ is a 4th order tensor with some interesting symmetry properties (isotropic). It is also the identity element for the Frobenius product, i.e. for any matrix $B$
$${mathcal H}:B=B:{mathcal H}=B$$
Now we can answer your first question. The function of interest is scalar-valued. Let's find its differential and gradient
$$eqalign{
phi &= a^TA^{-1}b cr &= ab^T:A^{-1} cr
dphi &= ab^T:dA^{-1} cr &= -ab^T:A^{-1},dA,A^{-1} cr
&= -A^{-T}ab^TA^{-T}:dA cr
frac{partialphi}{partial A} &= -A^{-T}ab^TA^{-T} cr
}$$
Now let's try the second question. This time the function of interest is matrix-valued.
$$eqalign{
F &= A^{-1}ab^TA^{-1} cr
dF &= dA^{-1}ab^TA^{-1} + A^{-1}ab^TdA^{-1} cr
&= -A^{-1},dA,A^{-1}ab^TA^{-1} - A^{-1}ab^TA^{-1},dA,A^{-1} cr
&= -A^{-1},dA,F - F,dA,A^{-1} cr
&= -Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA cr
frac{partial F}{partial A} &= -Big(A^{-1}{mathcal H}F^T+F{mathcal H}A^{-T}Big) cr
}$$
This gradient is a 4th order tensor.
If you prefer, you can vectorize the matrices to flatten the result.
$$eqalign{
{rm vec}(dF) &= -{rm vec}(-A^{-1},dA,F + F,dA,A^{-1}) cr
&= -(F^Totimes A^{-1} + A^{-T}otimes F),{rm vec}(dA) cr
df &= -(F^Totimes A^{-1} + A^{-T}otimes F),da cr
frac{partial f}{partial a} &= -Big(F^Totimes A^{-1} + A^{-T}otimes FBig) crcr
}$$
In some step above, a colon was used to denote the Frobenius (double-contraction) product
$$eqalign{
A &= {mathcal H}:B &implies &A_{ij} &= sum_{kl}{mathcal H}_{ijkl} B_{kl} cr alpha &= H:B &implies &alpha &= sum_{ij}H_{ij} B_{ij} = {rm Tr}(H^TB) cr
}$$
$endgroup$
1
$begingroup$
it might be obvious to you and others, but can you explain how to reach from this step $-A^{-1},dA,F - F,dA,A^{-1}$ to this step $-Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA$?
$endgroup$
– user550103
Dec 4 '18 at 6:04
1
$begingroup$
It's not obvious, it's just one of the properties of ${mathcal H}$. Work out a simple example like $(A{mathcal H}B:X)$ in index notation and, utilizing the properties of those Kronecker deltas, you'll find that it equals $(AXB^T)$
$endgroup$
– greg
Dec 4 '18 at 13:14
1
$begingroup$
It's also closely related to the equally non-obvious formula $${rm vec}(AXB^T) = (Botimes A),{rm vec}(X)$$ which uses a Kronecker product instead of Kronecker deltas.
$endgroup$
– greg
Dec 4 '18 at 13:22
$begingroup$
Thank you for the explanation, greg!
$endgroup$
– user550103
Dec 5 '18 at 9:58
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3023692%2fderivative-of-inverse-matrix-by-itself%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Start with the defining equation for the matrix inverse and find its differential.
$$eqalign{
I &= A^{-1}A cr
0 &= dA^{-1},A + A^{-1},dA cr
0 &= dA^{-1},A + A^{-1},dA,A^{-1} cr
dA^{-1} &= -A^{-1},dA,A^{-1} cr
}$$
Next note the gradient of a matrix with respect to itself.
$$
{mathcal H}_{ijkl} = frac{partial A_{ij}}{partial A_{kl}} = delta_{ik}delta_{jl}
$$
Note that ${mathcal H}$ is a 4th order tensor with some interesting symmetry properties (isotropic). It is also the identity element for the Frobenius product, i.e. for any matrix $B$
$${mathcal H}:B=B:{mathcal H}=B$$
Now we can answer your first question. The function of interest is scalar-valued. Let's find its differential and gradient
$$eqalign{
phi &= a^TA^{-1}b cr &= ab^T:A^{-1} cr
dphi &= ab^T:dA^{-1} cr &= -ab^T:A^{-1},dA,A^{-1} cr
&= -A^{-T}ab^TA^{-T}:dA cr
frac{partialphi}{partial A} &= -A^{-T}ab^TA^{-T} cr
}$$
Now let's try the second question. This time the function of interest is matrix-valued.
$$eqalign{
F &= A^{-1}ab^TA^{-1} cr
dF &= dA^{-1}ab^TA^{-1} + A^{-1}ab^TdA^{-1} cr
&= -A^{-1},dA,A^{-1}ab^TA^{-1} - A^{-1}ab^TA^{-1},dA,A^{-1} cr
&= -A^{-1},dA,F - F,dA,A^{-1} cr
&= -Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA cr
frac{partial F}{partial A} &= -Big(A^{-1}{mathcal H}F^T+F{mathcal H}A^{-T}Big) cr
}$$
This gradient is a 4th order tensor.
If you prefer, you can vectorize the matrices to flatten the result.
$$eqalign{
{rm vec}(dF) &= -{rm vec}(-A^{-1},dA,F + F,dA,A^{-1}) cr
&= -(F^Totimes A^{-1} + A^{-T}otimes F),{rm vec}(dA) cr
df &= -(F^Totimes A^{-1} + A^{-T}otimes F),da cr
frac{partial f}{partial a} &= -Big(F^Totimes A^{-1} + A^{-T}otimes FBig) crcr
}$$
In some step above, a colon was used to denote the Frobenius (double-contraction) product
$$eqalign{
A &= {mathcal H}:B &implies &A_{ij} &= sum_{kl}{mathcal H}_{ijkl} B_{kl} cr alpha &= H:B &implies &alpha &= sum_{ij}H_{ij} B_{ij} = {rm Tr}(H^TB) cr
}$$
$endgroup$
1
$begingroup$
it might be obvious to you and others, but can you explain how to reach from this step $-A^{-1},dA,F - F,dA,A^{-1}$ to this step $-Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA$?
$endgroup$
– user550103
Dec 4 '18 at 6:04
1
$begingroup$
It's not obvious, it's just one of the properties of ${mathcal H}$. Work out a simple example like $(A{mathcal H}B:X)$ in index notation and, utilizing the properties of those Kronecker deltas, you'll find that it equals $(AXB^T)$
$endgroup$
– greg
Dec 4 '18 at 13:14
1
$begingroup$
It's also closely related to the equally non-obvious formula $${rm vec}(AXB^T) = (Botimes A),{rm vec}(X)$$ which uses a Kronecker product instead of Kronecker deltas.
$endgroup$
– greg
Dec 4 '18 at 13:22
$begingroup$
Thank you for the explanation, greg!
$endgroup$
– user550103
Dec 5 '18 at 9:58
add a comment |
$begingroup$
Start with the defining equation for the matrix inverse and find its differential.
$$eqalign{
I &= A^{-1}A cr
0 &= dA^{-1},A + A^{-1},dA cr
0 &= dA^{-1},A + A^{-1},dA,A^{-1} cr
dA^{-1} &= -A^{-1},dA,A^{-1} cr
}$$
Next note the gradient of a matrix with respect to itself.
$$
{mathcal H}_{ijkl} = frac{partial A_{ij}}{partial A_{kl}} = delta_{ik}delta_{jl}
$$
Note that ${mathcal H}$ is a 4th order tensor with some interesting symmetry properties (isotropic). It is also the identity element for the Frobenius product, i.e. for any matrix $B$
$${mathcal H}:B=B:{mathcal H}=B$$
Now we can answer your first question. The function of interest is scalar-valued. Let's find its differential and gradient
$$eqalign{
phi &= a^TA^{-1}b cr &= ab^T:A^{-1} cr
dphi &= ab^T:dA^{-1} cr &= -ab^T:A^{-1},dA,A^{-1} cr
&= -A^{-T}ab^TA^{-T}:dA cr
frac{partialphi}{partial A} &= -A^{-T}ab^TA^{-T} cr
}$$
Now let's try the second question. This time the function of interest is matrix-valued.
$$eqalign{
F &= A^{-1}ab^TA^{-1} cr
dF &= dA^{-1}ab^TA^{-1} + A^{-1}ab^TdA^{-1} cr
&= -A^{-1},dA,A^{-1}ab^TA^{-1} - A^{-1}ab^TA^{-1},dA,A^{-1} cr
&= -A^{-1},dA,F - F,dA,A^{-1} cr
&= -Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA cr
frac{partial F}{partial A} &= -Big(A^{-1}{mathcal H}F^T+F{mathcal H}A^{-T}Big) cr
}$$
This gradient is a 4th order tensor.
If you prefer, you can vectorize the matrices to flatten the result.
$$eqalign{
{rm vec}(dF) &= -{rm vec}(-A^{-1},dA,F + F,dA,A^{-1}) cr
&= -(F^Totimes A^{-1} + A^{-T}otimes F),{rm vec}(dA) cr
df &= -(F^Totimes A^{-1} + A^{-T}otimes F),da cr
frac{partial f}{partial a} &= -Big(F^Totimes A^{-1} + A^{-T}otimes FBig) crcr
}$$
In some step above, a colon was used to denote the Frobenius (double-contraction) product
$$eqalign{
A &= {mathcal H}:B &implies &A_{ij} &= sum_{kl}{mathcal H}_{ijkl} B_{kl} cr alpha &= H:B &implies &alpha &= sum_{ij}H_{ij} B_{ij} = {rm Tr}(H^TB) cr
}$$
$endgroup$
1
$begingroup$
it might be obvious to you and others, but can you explain how to reach from this step $-A^{-1},dA,F - F,dA,A^{-1}$ to this step $-Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA$?
$endgroup$
– user550103
Dec 4 '18 at 6:04
1
$begingroup$
It's not obvious, it's just one of the properties of ${mathcal H}$. Work out a simple example like $(A{mathcal H}B:X)$ in index notation and, utilizing the properties of those Kronecker deltas, you'll find that it equals $(AXB^T)$
$endgroup$
– greg
Dec 4 '18 at 13:14
1
$begingroup$
It's also closely related to the equally non-obvious formula $${rm vec}(AXB^T) = (Botimes A),{rm vec}(X)$$ which uses a Kronecker product instead of Kronecker deltas.
$endgroup$
– greg
Dec 4 '18 at 13:22
$begingroup$
Thank you for the explanation, greg!
$endgroup$
– user550103
Dec 5 '18 at 9:58
add a comment |
$begingroup$
Start with the defining equation for the matrix inverse and find its differential.
$$eqalign{
I &= A^{-1}A cr
0 &= dA^{-1},A + A^{-1},dA cr
0 &= dA^{-1},A + A^{-1},dA,A^{-1} cr
dA^{-1} &= -A^{-1},dA,A^{-1} cr
}$$
Next note the gradient of a matrix with respect to itself.
$$
{mathcal H}_{ijkl} = frac{partial A_{ij}}{partial A_{kl}} = delta_{ik}delta_{jl}
$$
Note that ${mathcal H}$ is a 4th order tensor with some interesting symmetry properties (isotropic). It is also the identity element for the Frobenius product, i.e. for any matrix $B$
$${mathcal H}:B=B:{mathcal H}=B$$
Now we can answer your first question. The function of interest is scalar-valued. Let's find its differential and gradient
$$eqalign{
phi &= a^TA^{-1}b cr &= ab^T:A^{-1} cr
dphi &= ab^T:dA^{-1} cr &= -ab^T:A^{-1},dA,A^{-1} cr
&= -A^{-T}ab^TA^{-T}:dA cr
frac{partialphi}{partial A} &= -A^{-T}ab^TA^{-T} cr
}$$
Now let's try the second question. This time the function of interest is matrix-valued.
$$eqalign{
F &= A^{-1}ab^TA^{-1} cr
dF &= dA^{-1}ab^TA^{-1} + A^{-1}ab^TdA^{-1} cr
&= -A^{-1},dA,A^{-1}ab^TA^{-1} - A^{-1}ab^TA^{-1},dA,A^{-1} cr
&= -A^{-1},dA,F - F,dA,A^{-1} cr
&= -Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA cr
frac{partial F}{partial A} &= -Big(A^{-1}{mathcal H}F^T+F{mathcal H}A^{-T}Big) cr
}$$
This gradient is a 4th order tensor.
If you prefer, you can vectorize the matrices to flatten the result.
$$eqalign{
{rm vec}(dF) &= -{rm vec}(-A^{-1},dA,F + F,dA,A^{-1}) cr
&= -(F^Totimes A^{-1} + A^{-T}otimes F),{rm vec}(dA) cr
df &= -(F^Totimes A^{-1} + A^{-T}otimes F),da cr
frac{partial f}{partial a} &= -Big(F^Totimes A^{-1} + A^{-T}otimes FBig) crcr
}$$
In some step above, a colon was used to denote the Frobenius (double-contraction) product
$$eqalign{
A &= {mathcal H}:B &implies &A_{ij} &= sum_{kl}{mathcal H}_{ijkl} B_{kl} cr alpha &= H:B &implies &alpha &= sum_{ij}H_{ij} B_{ij} = {rm Tr}(H^TB) cr
}$$
$endgroup$
Start with the defining equation for the matrix inverse and find its differential.
$$eqalign{
I &= A^{-1}A cr
0 &= dA^{-1},A + A^{-1},dA cr
0 &= dA^{-1},A + A^{-1},dA,A^{-1} cr
dA^{-1} &= -A^{-1},dA,A^{-1} cr
}$$
Next note the gradient of a matrix with respect to itself.
$$
{mathcal H}_{ijkl} = frac{partial A_{ij}}{partial A_{kl}} = delta_{ik}delta_{jl}
$$
Note that ${mathcal H}$ is a 4th order tensor with some interesting symmetry properties (isotropic). It is also the identity element for the Frobenius product, i.e. for any matrix $B$
$${mathcal H}:B=B:{mathcal H}=B$$
Now we can answer your first question. The function of interest is scalar-valued. Let's find its differential and gradient
$$eqalign{
phi &= a^TA^{-1}b cr &= ab^T:A^{-1} cr
dphi &= ab^T:dA^{-1} cr &= -ab^T:A^{-1},dA,A^{-1} cr
&= -A^{-T}ab^TA^{-T}:dA cr
frac{partialphi}{partial A} &= -A^{-T}ab^TA^{-T} cr
}$$
Now let's try the second question. This time the function of interest is matrix-valued.
$$eqalign{
F &= A^{-1}ab^TA^{-1} cr
dF &= dA^{-1}ab^TA^{-1} + A^{-1}ab^TdA^{-1} cr
&= -A^{-1},dA,A^{-1}ab^TA^{-1} - A^{-1}ab^TA^{-1},dA,A^{-1} cr
&= -A^{-1},dA,F - F,dA,A^{-1} cr
&= -Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA cr
frac{partial F}{partial A} &= -Big(A^{-1}{mathcal H}F^T+F{mathcal H}A^{-T}Big) cr
}$$
This gradient is a 4th order tensor.
If you prefer, you can vectorize the matrices to flatten the result.
$$eqalign{
{rm vec}(dF) &= -{rm vec}(-A^{-1},dA,F + F,dA,A^{-1}) cr
&= -(F^Totimes A^{-1} + A^{-T}otimes F),{rm vec}(dA) cr
df &= -(F^Totimes A^{-1} + A^{-T}otimes F),da cr
frac{partial f}{partial a} &= -Big(F^Totimes A^{-1} + A^{-T}otimes FBig) crcr
}$$
In some step above, a colon was used to denote the Frobenius (double-contraction) product
$$eqalign{
A &= {mathcal H}:B &implies &A_{ij} &= sum_{kl}{mathcal H}_{ijkl} B_{kl} cr alpha &= H:B &implies &alpha &= sum_{ij}H_{ij} B_{ij} = {rm Tr}(H^TB) cr
}$$
edited Dec 3 '18 at 16:07
answered Dec 3 '18 at 15:35
greggreg
7,9101821
7,9101821
1
$begingroup$
it might be obvious to you and others, but can you explain how to reach from this step $-A^{-1},dA,F - F,dA,A^{-1}$ to this step $-Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA$?
$endgroup$
– user550103
Dec 4 '18 at 6:04
1
$begingroup$
It's not obvious, it's just one of the properties of ${mathcal H}$. Work out a simple example like $(A{mathcal H}B:X)$ in index notation and, utilizing the properties of those Kronecker deltas, you'll find that it equals $(AXB^T)$
$endgroup$
– greg
Dec 4 '18 at 13:14
1
$begingroup$
It's also closely related to the equally non-obvious formula $${rm vec}(AXB^T) = (Botimes A),{rm vec}(X)$$ which uses a Kronecker product instead of Kronecker deltas.
$endgroup$
– greg
Dec 4 '18 at 13:22
$begingroup$
Thank you for the explanation, greg!
$endgroup$
– user550103
Dec 5 '18 at 9:58
add a comment |
1
$begingroup$
it might be obvious to you and others, but can you explain how to reach from this step $-A^{-1},dA,F - F,dA,A^{-1}$ to this step $-Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA$?
$endgroup$
– user550103
Dec 4 '18 at 6:04
1
$begingroup$
It's not obvious, it's just one of the properties of ${mathcal H}$. Work out a simple example like $(A{mathcal H}B:X)$ in index notation and, utilizing the properties of those Kronecker deltas, you'll find that it equals $(AXB^T)$
$endgroup$
– greg
Dec 4 '18 at 13:14
1
$begingroup$
It's also closely related to the equally non-obvious formula $${rm vec}(AXB^T) = (Botimes A),{rm vec}(X)$$ which uses a Kronecker product instead of Kronecker deltas.
$endgroup$
– greg
Dec 4 '18 at 13:22
$begingroup$
Thank you for the explanation, greg!
$endgroup$
– user550103
Dec 5 '18 at 9:58
1
1
$begingroup$
it might be obvious to you and others, but can you explain how to reach from this step $-A^{-1},dA,F - F,dA,A^{-1}$ to this step $-Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA$?
$endgroup$
– user550103
Dec 4 '18 at 6:04
$begingroup$
it might be obvious to you and others, but can you explain how to reach from this step $-A^{-1},dA,F - F,dA,A^{-1}$ to this step $-Big(A^{-1}{mathcal H}F^T + F{mathcal H}A^{-T}Big):dA$?
$endgroup$
– user550103
Dec 4 '18 at 6:04
1
1
$begingroup$
It's not obvious, it's just one of the properties of ${mathcal H}$. Work out a simple example like $(A{mathcal H}B:X)$ in index notation and, utilizing the properties of those Kronecker deltas, you'll find that it equals $(AXB^T)$
$endgroup$
– greg
Dec 4 '18 at 13:14
$begingroup$
It's not obvious, it's just one of the properties of ${mathcal H}$. Work out a simple example like $(A{mathcal H}B:X)$ in index notation and, utilizing the properties of those Kronecker deltas, you'll find that it equals $(AXB^T)$
$endgroup$
– greg
Dec 4 '18 at 13:14
1
1
$begingroup$
It's also closely related to the equally non-obvious formula $${rm vec}(AXB^T) = (Botimes A),{rm vec}(X)$$ which uses a Kronecker product instead of Kronecker deltas.
$endgroup$
– greg
Dec 4 '18 at 13:22
$begingroup$
It's also closely related to the equally non-obvious formula $${rm vec}(AXB^T) = (Botimes A),{rm vec}(X)$$ which uses a Kronecker product instead of Kronecker deltas.
$endgroup$
– greg
Dec 4 '18 at 13:22
$begingroup$
Thank you for the explanation, greg!
$endgroup$
– user550103
Dec 5 '18 at 9:58
$begingroup$
Thank you for the explanation, greg!
$endgroup$
– user550103
Dec 5 '18 at 9:58
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3023692%2fderivative-of-inverse-matrix-by-itself%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
2
$begingroup$
First formula; is not it $-A^ {-2}$ ?
$endgroup$
– Damien
Dec 3 '18 at 6:36
$begingroup$
@Damien Yes, i editted
$endgroup$
– user1292919
Dec 3 '18 at 15:26
$begingroup$
Do you just know the first identity you stated or also how to obtain it? Because if so, you should be able to figure out the other identities too. However, please let us know what your attempts are.
$endgroup$
– James
Dec 3 '18 at 15:41