Probability and Statistics
Pure probabilistic or statistical analysis
Capitalization Coupling: The Dow, S&P, and Russell At Correlation Highs
Last summer, I often covered the difference in short-term performance between the Russell 2000 and S&P 500. I suggested that the VIX, as a measure of implied volatility, was a good predictor for this capitalization premium, and that claim often held up. I even went so far as to analyze the high-amplitude periods of this relationship. However, as the actual volatility of volatility has increased dramatically since last fall, my suggestions have been more and more difficult to implement.
I wanted to explore why this relationship had changed, and so I've taken a look at the Dow 30 (DIA), S&P 500 (SPY), and Russell 2000 (IWM) since 2002. The figure below shows the cumulative return of each index ETF in the top pane. The bottom pane shows the trailing 100-session percentage-correlation between each pair of indexes.

One of the most striking features of these plots is that all three indexes are trading at or above their highest historical correlations on this range. The only timespan of comparable length was during late 2002 and early 2003 as a short bear market held sway.
The other relationship that caught my eye was that the trend in correlation between the indexes was inversely related to the overall market performance. In other words, as the correlation between indexes fell, the markets rose on average. Furthermore, during these falling correlation periods, the Russell often outperformed its counterparts, and vice versa in rising correlation periods. This relationship likely reflects the fact that the capitalization premium and discount on small caps and large caps is very much a function of the strength of the economy and credit market.
In the future, I'll be watching closely for a decline in the correlation between these indexes as a confirmation of overall market uptrend.
- Michael J Bommarito II's blog
- 2 comments
- 3711 reads
ProShares Ultra & UltraShort: Does 2 = 2?
ProShares has offered a variety of "Ultra" and "UltraShort" sector ETFs for more than a year now. These funds are designed to track twice the return of the underlying index, and each corresponding long fund is created to match its corresponding short.
There is no doubt that these ProShares offerings have been the subject of a great deal of interest. They promise the rewards of leveraged sector returns without the headache of margin or portfolio construction, allowing profitable bets with less capital and less risk. This might not come for free, however, and many have investigated how closely these funds track their double-return target in terms of price. For more on that topic, I suggest this article directly from ProShares.
Instead of asking whether these funds track twice their underlying index, however, I've decided to investigate whether each pair of funds behaves as expected. That is, given two well-constructed index portfolios, the sum of the long fund's return and the short fund's return should equal zero. Though the behavior of the underlying derivatives might be expected to introduce some tracking error, we should expect to see only relatively small differences relating to the difference between price and NAV.
The following chart demonstrates the cumulative return difference between the long and short funds.
The chart demonstrates that this is far from the case. In fact, nearly half of the sectors have seen over 20% deficits in this balance since June of last year.
Looking for explanations outside of portfolio construction leads to a believable alternative. Charting dollar volume differences shows that almost every single sector had greater dollar volumes on the short side. In some sectors like Materials and Real Estate, the difference in dollar flow over the past year has hit tens of billions. It seems likely that these funds are much more valuable as insurance for the down-side than as single-sector long bets. In other words, if investor are much more likely to bid on and bid up an UltraShort Sector insurance contract, imbalances such as these might be expected.
Select Sector SPDR Returns and Volatility Relative to the S&P 500 As Of November 30th, 2007
The past week provided the first signs of support in the overall market for a long while, with financials rising, energy falling, and two consecutive overall days in the black. The top gainers relative to the S&P for the week were financials and materials, with energy and technology falling the hardest compared to the market. Crude fell below $90 on Friday as well, likely decreasing inflationary pressure and giving the Fed less downside risk for lowering rates, further widening the difference between financials and energy.
With respect to volatility, utilities and staples remained the least risky relative to the S&P, with financials and discretionary coming up on top on the other side.
Here are the table summaries.
Return
| Symbol | Week | 2 Week | Month | 3 Month |
| XLF | 2.7% | -1.3% | -1.6% | -7.4% |
| XLB | 2.2% | 1.3% | -0.1% | 4.8% |
| XLV | 0.5% | 0.9% | 4.3% | 4.4% |
| XLY | 0.1% | -0.3% | -1.5% | -6.6% |
| XLI | 0.1% | -0.6% | 0.4% | -0.6% |
| XLP | -0.8% | 0.5% | 6.3% | 8.0% |
| XLU | -1.2% | 0.4% | 4.3% | 8.3% |
| XLK | -1.3% | -0.9% | -5.2% | -0.8% |
| XLE | -3.9% | 1.6% | 0.3% | 1.7% |
Volatility
| Symbol | Week | 2 Week | Month | 3 Month |
| XLU | -1.1% | -0.9% | -0.6% | -0.2% |
| XLP | -1.0% | -0.8% | -0.8% | -0.5% |
| XLV | -0.8% | -0.4% | -0.5% | -0.3% |
| XLI | -0.4% | -0.3% | -0.2% | -0.0% |
| XLK | -0.1% | -0.0% | 0.2% | 0.1% |
| XLE | 0.3% | 0.7% | 1.1% | 0.8% |
| XLB | 0.4% | 0.5% | 0.6% | 0.5% |
| XLY | 0.5% | 0.3% | 0.1% | 0.2% |
| XLF | 1.5% | 1.2% | 1.1% | 0.8% |
- Michael J Bommarito II's blog
- Add new comment
- 1588 reads
Select Sector SPDR Minimum Spanning Trees As Of November 27th, 2007
I've covered sector minimum spanning trees many times in the past, and here we see the current trees for the past week and month. As minimum paths within the log-return correlation matrix, they represent the structure and dynamics of the market as broken into sectors.
Notice that utilities and energy have been especially distant from the S&P and that the Russell has been most tied to the weak discretionary and financials over both intervals.
Week MST

Month MST

- Michael J Bommarito II's blog
- 1 comment
- 2192 reads
Change in Select SPDR Sector ETF Correlation to S&P 500: November 21st, 2007
In the past, I've covered the difference between long-term and short-term sector-to-market correlations as a possible arbitrage opportunity. I've performed the analysis just as before, comparing the correlation over the past 50 periods to the previous 500 periods.
Note that relative to September, most sectors are much closer to the fair line (50-session correlation = 500-session correlation). Most noticeably changed is energy, which is currently exhibiting a much higher correlation. Note as well that financials and consumer discretionary seem much less attractive in a possible bear market, while utilities comes is actually even less correlated currently than in the long-run.
Here is the table of the actual differences.
| Symbol | Correlation Change |
| XLB | 6.6% |
| XLE | 15.5% |
| XLF | 2.3% |
| XLI | 6.6% |
| XLK | -2.5% |
| XLP | 7.3% |
| XLU | -2.5% |
| XLV | 5.9% |
| XLY | -0.5% |
- Michael J Bommarito II's blog
- Add new comment
- 1873 reads
Select Sector SPDR Returns and Volatility Relative to the S&P 500
The divergence between sectors over the last few weeks has marked, with financials and consumer discretionary getting hit the worst. On the upside, concerned investors have reward the consumer staples and utilities funds, both for their safer profile and attractive dividends with falling rates.
Here are two tables summarizing the performance of the Select SPDR Sector ETFs relative to the S&P 500. The first table shows the excess log-return over the indicated period between the fund and the S&P 500 tracker, while the second table shows the amount of volatility (standard deviation of log-return) above the S&P 500 over the specified interval.
Excess Returns
| Symbol | Week | 2 Week | Month | 3 Month |
| XLF | -6.3% | -4.1% | -8.5% | -14.3% |
| XLY | -2.4% | -1.5% | -4.3% | -8.0% |
| XLI | -0.7% | -1.0% | -0.3% | -0.4% |
| XLB | -0.7% | -3.4% | -0.9% | 3.3% |
| XLK | 0.8% | -3.3% | -1.2% | 2.9% |
| XLV | 2.2% | 4.5% | 4.2% | 4.5% |
| XLE | 2.9% | -0.3% | 3.7% | 8.9% |
| XLP | 3.3% | 6.2% | 6.9% | 7.4% |
| XLU | 4.2% | 4.8% | 10.3% | 11.0% |
Excess Volatility
| Symbol | Week | 2 Week | Month | 3 Month |
| XLE | 1.9% | 1.6% | 1.4% | 0.8% |
| XLB | 0.9% | 0.7% | 0.8% | 0.5% |
| XLK | 0.5% | 0.6% | 0.3% | 0.1% |
| XLF | 0.2% | 1.2% | 1.1% | 0.7% |
| XLY | 0.1% | -0.0% | -0.0% | 0.2% |
| XLI | -0.2% | -0.1% | -0.1% | 0.1% |
| XLU | -0.2% | -0.2% | -0.1% | -0.1% |
| XLP | -0.3% | -0.7% | -0.5% | -0.5% |
| XLV | -0.4% | -0.6% | -0.5% | -0.4% |
- Michael J Bommarito II's blog
- Add new comment
- 1516 reads
ETF Market Summary: Wednesday, October 3rd 2007
Dollar-Weighted Category Summary
| Day | Week | Month | YTD | Day $ % | RSI5 | ΔRSI5 | SPY R | |
| China | -5.2% | 1.6% | 20.1% | 7.9% | 7.1% | 50.0 | -28.1 | 62.0% |
| Latin & South America | -3.9% | 1.5% | 15.4% | 5.1% | 6.7% | 54.8 | -28.7 | 58.3% |
| Emerging Markets | -3.0% | 1.6% | 12.3% | 2.4% | 13.0% | 68.0 | -13.1 | 70.8% |
| Russia | -2.1% | 1.6% | 10.9% | -4.2% | 0.1% | 58.8 | -29.5 | 62.5% |
| Transports | -1.5% | 0.4% | 0.4% | 4.7% | 0.3% | 55.2 | -39.8 | 65.4% |
| Asia | -1.0% | 2.6% | 11.5% | 3.4% | 0.1% | 71.2 | -14.2 | 71.3% |
| Commodities & Resources | -1.0% | -0.5% | 6.6% | 2.3% | 0.7% | 58.6 | -6.5 | 24.9% |
| Energy | -0.6% | -0.1% | 5.5% | 1.9% | 8.4% | 47.5 | -11.2 | 40.5% |
| Precious Metals | -0.6% | -0.2% | 7.4% | 2.8% | 3.5% | 49.7 | -7.3 | 36.4% |
| Europe | -0.5% | 1.3% | 5.8% | 0.6% | 1.7% | 71.4 | -13.3 | 52.6% |
| Large Cap | -0.4% | 0.9% | 5.1% | 0.5% | 10.0% | 70.9 | -13.8 | 84.9% |
| Municipal | -0.3% | 0.3% | 1.4% | 0.0% | 0.5% | 56.9 | -5.8 | 2.0% |
| Utilities & Infrastructure | -0.3% | -0.8% | 3.6% | 0.7% | 1.2% | 46.0 | -15.4 | 54.4% |
| Small Cap | -0.3% | 2.2% | 4.5% | 0.2% | 25.9% | 76.4 | -7.7 | 64.9% |
| Currency | -0.2% | -0.3% | 2.3% | 1.1% | 0.6% | 51.2 | -5.4 | 0.4% |
| Convertible | -0.1% | 0.8% | -1.8% | -0.7% | 0.1% | 66.7 | 4.9 | 6.2% |
| Dividend | -0.1% | 1.3% | 3.6% | 0.3% | 0.4% | 71.1 | -5.3 | 0.53 |
| Real Estate | 0.0% | 4.1% | 9.0% | -0.2% | 1.9% | 85.0 | 2.9 | 46.1% |
| Japan | 0.0% | 2.8% | 4.9% | 0.2% | 1.3% | 80.5 | -2.5 | 30.7% |
| Call/Write | 0.1% | 1.3% | 0.6% | -0.6% | 0.0% | 83.7 | 14.6 | 0.12 |
| Consumer Goods & Services | 0.2% | 1.3% | 3.0% | 0.1% | 2.4% | 75.0 | -16.3 | 48.2% |
| Mid Cap | 0.3% | 2.3% | 4.1% | 0.5% | 3.2% | 83.3 | -6.4 | 75.9% |
| Healthcare & Biotech | 0.3% | 0.9% | 4.3% | 0.6% | 0.9% | 64.3 | -7.9 | 57.0% |
| Retail | 0.4% | 0.9% | 1.8% | 0.4% | 2.5% | 78.1 | 0.4 | 3.0% |
| Short | 0.9% | -2.1% | -9.1% | -2.8% | 7.5% | 30.9 | 15.1 | -86.5% |
| Average | -0.8% | 1.0% | 5.3% | 1.1% | 4.0% | 64.2 | -9.6 | 39.9% |
Top 10 ETF and CEF Advances and Declines
| Symbol | Name | Return |
| Top Declines | ||
| GCH | Greater China Fund Inc. | -7.6% |
| FXI | iShares FTSE/Xinhua China 25 Index Fund | -5.4% |
| EEB | Claymore/BNY BRIC ETF | -5.2% |
| PGJ | PowerShares Golden Dragon Halter USX China Portfolio | -5.1% |
| IF | Indonesia Fund | -4.8% |
| EWH | iShares MSCI Hong Kong Index Fund | -4.7% |
| ILF | iShares Latin America 40 Index Fund | -4.6% |
| EWZ | iShares MSCI Brazil Index Fund | -4.4% |
| ADRE | BLDRS Emerging Markets 50 ADR Index Fund | -4.0% |
| UVT | ProShares Ultra Russell2000 Value | -2.6% |
| Top Advances | ||
| ISL | First Israel Fund | 1.5% |
| CCA | Colonial California Insured Municipal | 1.5% |
| RNP | Cohen & Steers REIT & Preferred Income Fund | 1.7% |
| VTJ | Van Kampen Trust for Inv NJ Muni | 1.7% |
| XBI | SPDR S&P Biotech ETF | 1.7% |
| CLM | Cornerstone Strategic Value Fund | 1.8% |
| XHB | SPDR Homebuilders ETF | 2.1% |
| IRL | The New Ireland Fund | 2.3% |
| NRL | Neuberger Berman Real Estate Income Fund | 2.4% |
| BQH | BlackRock New York Municipal Bond Trust | 2.7% |
- Michael J Bommarito II's blog
- Add new comment
- 1347 reads
Monthly Return Distribution Holds Symmetric and Tightens Since Late August
Since the S&P's last low on August 27th, the trailing monthly distribution of daily Select Sector SPDR ETF returns has made new records. The following is a chart of the 20-session average skew and kurtosis of the SPDR sector ETFs and the SPY. It is very important to note, however, that I have calculated these numbers within each day - that is, these are the moments of the distribution of returns for each day, not the distribution of returns for each fund. Thus, for 20 days, there are 20 values for each moment, and the graph represents the average of these 20 values. These numbers are therefore an indicator of how symmetric and tight the sector returns have been over the past month. Lower kurtosis implies sectors moving within a tighter range, and thus likely higher sector correlation. Skewness indicates which tail is fatter, and thus the symmetry of the overall sector returns.
See how the kurtosis has reached an all-time low for these funds, dropping past the lows of July 2004. Skewness as well seems to be surfing along zero, implying a relatively symmetric and tightly central distribution of returns since the Fed cut.

- Michael J Bommarito II's blog
- Add new comment
- 1999 reads

Recent comments
13 weeks 2 days ago
18 weeks 2 days ago
22 weeks 17 hours ago
27 weeks 6 days ago
32 weeks 1 day ago
42 weeks 23 hours ago
43 weeks 1 day ago
51 weeks 22 hours ago
1 year 5 weeks ago
1 year 23 weeks ago