Thursday, April 26, 2012

Structural Breaks (Bull or Bear?)

When I spotted the bfast R package, I could not resist attempting to apply it to identify bull and bear markets.  For all the details that I do not understand, please see the references:

Jan Verbesselt, Rob Hyndman, Glenn Newnham, Darius Culvenor (2010). Detecting Trend and
  Seasonal Changes in Satellite Image Time Series. Remote Sensing of Environment, 114(1),
  106-115. doi:10.1016/j.rse.2009.08.014

Jan Verbesselt, Rob Hyndman, Achim Zeileis, Darius Culvenor (2010). Phenological Change
  Detection while Accounting for Abrupt and Gradual Trends in Satellite Image Time
  Series. Remote Sensing of Environment, 114(12), 2970 - 2980.
  doi:10.1016/j.rse.2010.08.003

I believe the result on the S&P 500 (even with a high h and only one iteration) is a fairly close marker for bull and bear markets, and I thoroughly enjoyed applying forestry techniques to financial time series.

From TimelyPortfolio
From TimelyPortfolio
From TimelyPortfolio

R code from GIST:

#analyze breakpoints with the R package bfast
#please read the paper
#Verbesselt J, Hyndman R, Newnham G, Culvenor D (2010)
#Detecting Trend and Seasonal Changes in Satellite Image Time Series.
#Remote Sensing of Environment, 114(1), 106–115.
#http://dx.doi.org/10.1016/j.rse.2009.08.014
require(bfast)
require(quantmod)
getSymbols("^GSPC",from="1950-01-01")
#convert to log price
GSPC.monthly <- log(to.monthly(GSPC)[,4])
#get monthly returns for the close price
#not necessary, leave in price form
#GSPC.return <- monthlyReturn(GSPC[,4])
#need ts representation so do some brute force conversion
GSPC.ts <- ts(as.vector(GSPC.monthly["1951-01::"]),start=c(1951,1),frequency=12)
#look at the stl Seasonal-Trend decomposition procedure already in R
GSPC.stl <- stl(GSPC.ts,s.window="periodic")
plot(GSPC.stl,main="STL Decomposition of S&P 500")
#get the results from bfast
#adjusting h lower will result in more breakpoints
GSPC.bfast <- bfast(GSPC.ts,h=0.2,max.iter=1,season="none")
plot(GSPC.bfast,type="components",ylim=c(3,max(GSPC.monthly)+1),main="S&P 500 with bfast Breakpoints and Components")
plot(GSPC.bfast,type="trend",ylim=c(3,max(GSPC.monthly)+1),main="S&P 500 with bfast Trend Breakpoints")
#see everything with type="all" but in bfast calculation set seasonal to "none"
#play away with this
#plot(GSPC.bfast,type="all")
#do some additional plotting
#[[1]] is used since for speed I only did one iteration
#could plot each iteration if I did multiple
plot(GSPC.bfast$Yt/GSPC.bfast$output[[1]]$Tt-1,
main="bfast Remainder as % of S&P 500 Price",
xlab=NA, ylab="remainder (% of price)",bty="l")
#add vertical line for the breakpoints
abline(v=breakdates(GSPC.bfast$output[[1]]$bp.Vt),col="gray70")
#add horizontal line at 0
abline(h=0,col="black",lty=2)
text(x=breakdates(GSPC.bfast$output[[1]]$bp.Vt),y=par("usr")[3]+.01,
labels=breakdates(GSPC.bfast$output[[1]]$bp.Vt,format.times=TRUE),
srt=90,pos=4,cex=0.75)

5 comments:

  1. Nice application! you can also detect seasonal breaks. also check some new near real-time disturbance detection functionality using bfastmonitor() http://bfast.r-forge.r-project.org/Verbesselt+Zeileis+Herold-2012.pdf
    cheers, Jan

    ReplyDelete
  2. Thanks for the interesting post. However I guess it would really make more sense to analyze the returns because one wouldn't expect trend stationarity for the (log) prices. Note also that bfast leverages tools from the strucchange package which has its roots in econometrics. There are write a few publications on analyzing structural change in return time series. Best regards, Achim

    ReplyDelete
    Replies
    1. Achim, you meant that the analysis can only be applied to stationary time series, so that we have to transform log prices into returns first? Thank you!

      Delete
  3. GSPC.bfast <- bfast(GSPC.ts,h=0.2,max.iter=10,season="none")

    I changed to max.iter=10 and the result is the same as before(at least seen from the trend Breakpoints plot)?

    ReplyDelete
  4. I really appreciate the comments, and it certainly seems your statistical knowledge exceeds mine. However, based on my understanding of trend stationarity, for my purposes, it is not necessary to transform the series and is actually harmful to detrend. It seems almost like removing the moving average from a moving average system. Please let me know how I have this wrong. Rather than removing the trend I want to highlight it and figure out how I can benefit from it.

    ReplyDelete