# Difference between revisions of "Analysis-Forecast Cycle Observation Impacts"

Line 8: | Line 8: | ||

− | In the figure above, each analysis cycle is assumed to be of length <math>\tau</math> and analysis cycle <math>j</math> spans the interval<math>[t_0^j,t_0^j+\tau]</math>. The circulation estimate at time <math>t_0^j+\tau</math> (i.e. the ''end'' of analysis cycle <math>j</math>) is denoted as <math>x_a^j</math> and is the initial condition for the forecast spanning the next analysis interval <math>[t_0^{j+1},t_0^{j+1}+\tau]</math>. In | + | In the figure above, each analysis cycle is assumed to be of length <math>\tau</math> and analysis cycle <math>j</math> spans the interval<math>[t_0^j,t_0^j+\tau]</math>. The circulation estimate at time <math>t_0^j+\tau</math> (i.e. the ''end'' of analysis cycle <math>j</math>) is denoted as <math>x_a^j</math> and is the initial condition for the forecast spanning the next analysis interval <math>[t_0^{j+1},t_0^{j+1}+\tau]</math>. In the figure it is assumed, for convenience only, that the forecast duration is an integer multiple of <math>\tau</math>, but this does not have to be the case, and the code is set up to handle analysis and forecast cycles that are different lengths. Figure 1 shows the analyses and forecasts that result from three adjacent analysis cycles, namely cycles <math>j</math>, <math>j+1</math> and cycle <math>j+2</math>. The analysis <math>x_a^j</math> at the end of cycle <math>j</math> is used as the initial condition for the forecast <math>x_f^j</math> of duration <math>2\tau</math> that terminates at time <math>t_0^{j+2}+\tau</math>, the end of analysis cycle <math>j+2</math>. Similarly, the analysis <math>x_a^{j+1}</math> at the end of cycle <math>j+1</math> is used as the initial condition for the forecast <math>x_f^{j+1}</math> of duration <math>\tau</math> and also terminates at time <math>t_0^{j+2}+\tau</math>, the end of analysis cycle <math>j+2</math>. After sufficient time has elapsed, a new analysis <math>x_a^{j+2}</math> will be computed at this time. Since <math>x_a^{j+2}</math> represents our best estimate of the ocean circulation at time <math>t_0^{j+2}+\tau</math> it can be used to quantify the veracity of the forecasts <math>x_f^j</math> and <math>x_f^{j+1}</math>. For this reason, <math>x_a^{j+2}</math> is usually referred to as the “verifying analysis.” However, as discussed shortly, other sources of information can be used to verify the forecasts, such as new or independent observations. |

− | It should be clear from the figure that the forecast <math>x_f^{j+1}</math> benefits from the observations assimilated into the model during analysis cycle <math>j+1</math> (i.e. during the interval <math>[t_0^{j+1},t_0^{j+1}+\tau]</math>). Therefore, providing that <math>x_f^j</math> and <math>x_f^{j+1}</math> are subject to identical surface forcing and open boundary conditions during the interval <math>[t_0^{j+2},t_0^{j+2}+\tau]</math>, any differences in forecast error must be associated with the observations assimilated into the model during the interval <math>[t_0^{j+1},t_0^{j+1}+\tau]</math>. | + | It should be clear from the figure that the forecast <math>x_f^{j+1}</math> benefits from the observations assimilated into the model during analysis cycle <math>j+1</math> (i.e. during the interval <math>[t_0^{j+1},t_0^{j+1}+\tau]</math>). Therefore, providing that <math>x_f^j</math> and <math>x_f^{j+1}</math> are subject to identical surface forcing and open boundary conditions during the interval <math>[t_0^{j+2},t_0^{j+2}+\tau]</math>, any differences in forecast error must be associated with the observations assimilated into the model during the interval <math>[t_0^{j+1},t_0^{j+1}+\tau]</math>. |

− | + | ||

+ | ==Forecast Error Metrics== | ||

+ | |||

+ | As in the case of the analysis cycle observation impacts described above, the impact of the observations during the forecast cycle is computed for a specific metric, in this case a metric of the forecast error. The methodology will be described first for a standard generic quadratic forecast error metric given by: | ||

+ | {| class="eqno" | ||

+ | |<math display="block">e=(\bold{x}_f-\bold{x}_t)^T \bold{C}(\bold{x}_f-\bold{x}_t)</math> | ||

+ | |(1) | ||

+ | |} | ||

+ | where <math>\bold{x}_f</math> denotes the forecast state-vector, <math>\bold{x}_t</math> denotes the true state-vector, and <math>\bold{C}</math> is a weight matrix. For example, if <math>\bold{C}</math> is a diagonal matrix with elements equal to 1 corresponding to all surface temperature grid points, and zero elsewhere, then <math>e</math> would represent the sum of the squared errors in SST. Forecast error metrics of the form (1) are very common in numerical weather prediction and oceanography, so (1) is a good starting point. | ||

+ | |||

+ | In the figure there are two forecasts of interest: <math>\bold{x}_f^j</math> initialized at the end of analysis cycle <math>j</math> at time <math>t_0^j+\tau</math>, and <math>\bold{x}_f^{j+1}</math> initialized at the end of analysis cycle <math>j+1</math> at time <math>t_0^{j+1}+\tau</math>. At time <math>t_0^{j+2}+\tau</math> the error in forecast <math>\bold{x}_f^j</math> is given by <math>e_b=(\bold{x}_f^j-\bold{x}_t )^T \bold{C}(\bold{x}_f^j-\bold{x}_t )</math>, while the error in <math>x_f^{j+1}</math> is given by <math>e_a=(\bold{x}_f^{j+1}-\bold{x}_t)^T \bold{C}(\bold{x}_f^{j+1}-\bold{x}_t)</math>. As noted above, if <math>\bold{x}_f^j</math> and <math>\bold{x}_f^{j+1}</math> are subject to ''identical'' surface forcing and open boundary conditions during the interval <math>[t_0^{j+2},t_0^{j+2}+\tau]</math>, then the difference in forecast error <math>\delta e=e_a-e_b</math> is due solely to the difference in the forecast initial conditions due to the observations assimilated during analysis cycle <math>j+1</math> spanning the interval <math>[t_0^{j+1},t_0^{j+1}+\tau]</math>. (The more realistic case where the two forecasts are subject to different surface forcing fields is addressed below in the “step-by-step procedure” notes). Specifically, if <math>\delta e<0</math> the observations assimilated during cycle <math>j+1</math> lead to an improvement in the forecast skill (i.e. <math>e_a<e_b</math>), while if <math>\delta e>0</math> the observations assimilated during cycle <math>j+1</math> have degraded the forecast (i.e. <math>e_a>e_b</math>). While this convention may seem counter-intuitive, it is the convention used in the numerical weather prediction literature, so it seems prudent to adopt it here. |

## Revision as of 06:23, 10 July 2019

The procedure for computing the observation impacts during the forecast cycle is a little more involved than that for the analysis cycle. However, a separate ROMS driver exists for this. To help illustrate the procedure involved, consider the typical analysis-forecast cycle shown schematically below.

In the figure above, each analysis cycle is assumed to be of length and analysis cycle spans the interval. The circulation estimate at time (i.e. the *end* of analysis cycle ) is denoted as and is the initial condition for the forecast spanning the next analysis interval . In the figure it is assumed, for convenience only, that the forecast duration is an integer multiple of , but this does not have to be the case, and the code is set up to handle analysis and forecast cycles that are different lengths. Figure 1 shows the analyses and forecasts that result from three adjacent analysis cycles, namely cycles , and cycle . The analysis at the end of cycle is used as the initial condition for the forecast of duration that terminates at time , the end of analysis cycle . Similarly, the analysis at the end of cycle is used as the initial condition for the forecast of duration and also terminates at time , the end of analysis cycle . After sufficient time has elapsed, a new analysis will be computed at this time. Since represents our best estimate of the ocean circulation at time it can be used to quantify the veracity of the forecasts and . For this reason, is usually referred to as the “verifying analysis.” However, as discussed shortly, other sources of information can be used to verify the forecasts, such as new or independent observations.

It should be clear from the figure that the forecast benefits from the observations assimilated into the model during analysis cycle (i.e. during the interval ). Therefore, providing that and are subject to identical surface forcing and open boundary conditions during the interval , any differences in forecast error must be associated with the observations assimilated into the model during the interval .

## Forecast Error Metrics

As in the case of the analysis cycle observation impacts described above, the impact of the observations during the forecast cycle is computed for a specific metric, in this case a metric of the forecast error. The methodology will be described first for a standard generic quadratic forecast error metric given by:

(1) |

where denotes the forecast state-vector, denotes the true state-vector, and is a weight matrix. For example, if is a diagonal matrix with elements equal to 1 corresponding to all surface temperature grid points, and zero elsewhere, then would represent the sum of the squared errors in SST. Forecast error metrics of the form (1) are very common in numerical weather prediction and oceanography, so (1) is a good starting point.

In the figure there are two forecasts of interest: initialized at the end of analysis cycle at time , and initialized at the end of analysis cycle at time . At time the error in forecast is given by , while the error in is given by . As noted above, if and are subject to *identical* surface forcing and open boundary conditions during the interval , then the difference in forecast error is due solely to the difference in the forecast initial conditions due to the observations assimilated during analysis cycle spanning the interval . (The more realistic case where the two forecasts are subject to different surface forcing fields is addressed below in the “step-by-step procedure” notes). Specifically, if the observations assimilated during cycle lead to an improvement in the forecast skill (i.e. ), while if the observations assimilated during cycle have degraded the forecast (i.e. ). While this convention may seem counter-intuitive, it is the convention used in the numerical weather prediction literature, so it seems prudent to adopt it here.