Essential reading for all prospective traders is Taleb's "Fooled by Randomness."
Markets are full of feedback loops, so you can't expect the same results with "paper" backtesting or "paper" forward testing as with real trades, especially in larger amounts.
With such paper testing you can discover and fool yourself with amazing high-probability, high-earning strategies that come with the hidden surprise of low probability catastrophic losses.
For example, many naive gamblers think that a strategy with a 45% chance to win, combined with betting to cover losses, will nearly always succeed because the odds of losing ten times in a row seem low. However, when the inevitable 11th loss occurs, it can be devastating.
I haven't read Taleb's book. But wouldn't the logic you employ apply to any strategy?
eg I could also say that you could fool yourself believing that investing in the S&P 500 index is a strategy with high-probability of performing well, with a hidden surprise of low-prob cat losses.
> But wouldn't the logic you employ apply to any strategy?
You ask a good question.
Consider a game like rock-paper-scissors. The goal is to predict your opponent's move. Among all possible strategies, the random strategy is unique because it can't be predicted. Any other strategy can be anticipated by a smarter opponent. Being random means you can't lose to a smarter opponent.
In trading, buying low and selling high requires prediction. Any strategy that relies on prediction becomes predictable to smarter opponents. Buy-and-hold index investing is the only strategy immune to this exploitation because you're effectively betting on everything. With passive index investing, your investments grow at the rate of business growth, making this strategy special.
I agree that competitors could outsmart you. But that's just like in any other kind of business. Doesn't mean entrepreneurs should give up trying to start a business.
And the probabilities of you succeeding won't be good, of course. But neither are the chances of a startup succeeding good either.
Trading, particularly short-term "buy low, sell high" strategies, differs fundamentally from businesses that create products or deliver services. In trading, profits are often directly linked to the losses of other market participants, making it a zero-sum activity. In other words, for every winner, there must be a corresponding loser on the other side of the trade.
This dynamic is similar to gambling games like Texas Hold'em poker in a casino setting. While skilled players may consistently profit at the expense of less experienced participants, the overall wealth within the game remains constant. No new value is generated; instead, existing wealth is redistributed among the players based on their relative performance and luck. When research time and fees are added trading is largely “negative sum”.
NOTE: Some trading activities, such as market making and arbitrage, provide liquidity and help maintain fair pricing in financial markets but these operations require expensive low latency market access and are dominated by market insiders and are not possible for retail traders.
While I do believe it provides liquidity in all cases, let's just focus on the zero-sum aspect. My response is - so what if it's a zero sum game? Why should someone care if that's the case? It's not as if all startups out there add value to the world.
> I never claimed that my strategy beats the sp500. It has underperformed, especially the way the market has been. The market has returned 25% over the last year.
After two years of research, you have developed a trading strategy that, compared to the S&P 500, "has underperformed, especially the way the market has been"? If your strategy depends on buying / selling it will trigger taxes each time this happens, yes? Short term gains taxes? When people switch from sp500 to your strategy how much less will then earn over a decade? Yet you claim your strategy "works"?
> The expected performance of the strategy is somewhere between 10% and 30%, but it is not clear what exactly.
If a profitable pattern exists, what makes you think nobody else has found it and that it will continue to exist in the future? Is it because few look for these profitable patterns? Are they poorly funded? Do they lack incentives to do it?
> I don't think it's necessarily fair to call others "dumb money". They can hold for longer and still profit with the market.
"Dumb money" refers to hobby traders who believe stock trading will make them rich. Some rely on gut feelings, while others use advice from astrology or technical analysis. Why do you suppose professional traders pay for order flow from such traders?
> The market is not a zero sum game because the market capitalization is several multiples of the total invested funds. The market is a money printer in its own way.
For every trade, there is a counterparty on the other side, and your gain is their loss and vice versa. This makes trading a zero-sum activity.
Furthermore, for every trade, there are middlemen who charge fees, making trading a negative-sum activity.
Long-term buying and holding is positive-sum investing and does not require a trading strategy or searching for profitable patterns.
> Precious metals as a currency do not work because the government doesn't have the freedom to mint an unlimited supply of hard assets.
The purpose of a currency is to facilitate transactions and maintain stable prices in the short term while losing value in the long term to discourage hoarding. Gold cannot achieve this because the amount of gold cannot be adjusted to match the size of the economy as it grows or shrinks. When the economy grows, using gold as money will cause it to stall because people will save up gold as it becomes more valuable instead of spending it. Deflationary currencies like gold are detrimental to economic growth, which is why modern countries no longer use them.
> The government holds a gun to people's heads, locking them up if they don't use the highly inflationary national currencies.
Are you surprised by inflation? Saving your wealth using a currency does not make sense since it is designed to lose value over time.
If you prefer precious metals, what prevents you from keeping your wealth in gold (a negative-sum asset) and converting it to fiat currency only when needed?
> Countries are run by politicians, bureaucrats, and armed police mafia who care about their paycheck and pensions which wouldn't be so big if not for free moneyprinting at the expense of the citizenry. The people do not have freedom of their choice of money.
Countries are "owned" by their voters. Government debts are your debts. Inflation is just another tax like other taxes. If you are dissatisfied with the current situation, get involved to change it.
HN had an error during saving and when I attempted again I picked the wrong message and can not change or delete it now. I will add an extra answer later.
This is true, but traders like me chase it anyway, refining the strategy at each failure. If there is no refinement possible, then the trades should stop.
You make it sound like you are improving yet with all traders like you "chasing it anyway, refining the strategy at each failure" what exactly are you improving? When you play a game like "rock paper scissors" what refinement is possible?
Due to market feedback loops the patterns you look for profits are transient. When they do persist do you ever wonder about them being like fake "tells" in poker that lure you to bet big setting you up to be smashed later?
High frequency trading / front running information and arbitrage may be profitable but require low latency costly access.
Apart for that my impression is that technical analysis based short term trading (as opposed to long term investing) is on net a negative sum activity. Like a game of "rock paper scissors" there is nothing to improve.
I don't view it as RPS. I view it a bit as a game of chess. Whether it is a net positive or net negative, time will tell. I am not claiming success. Those who are so mentally closed off that they will downvote any differing opinion without understanding it will never succeed with it.
Given the possible winnings and bad players lose their chips to good ones and retire
what skill level do you suppose is on the other side of this game? Given this you still play?
> Whether it is a net positive or net negative, time will tell.
For you "time will tell" because evidence from rational thinking and the experience of countless others is not enough?
> Those who are so mentally closed off that they will downvote any differing opinion without understanding it will never succeed with it.
Hence I am not voting but asking questions trying to understand your "differing opinion". You view the activity as a game of chess. I view it as an effort to construct a perpetual motion machine. What matters is the money and time wasted on what is known not to be possible. What matters is why someone who seems intelligent fails to understand this. Perhaps they do and so actually have a different plan than building a perpetual motion machine. Maybe they are building an audience of those who believe in perpetual motion machines?
> I am not claiming success.
Yet you or at least the author of the article seem to believe if they stick with this "research" they will be successful? How long till they claim to have success and, for a price, offer to share the benefits of their success with you?
You wouldn't want to confuse my cautiousness with failure. My system works, but:
(1) It doesn't beat the market on green market days or overall. Given how the market has been since October 2023, you'd do a lot better by just holding an ETF.
(2) It does make money on red market days too.
(3) Overall it does earn and is successful, but I express caution because I think that at least four consecutive years of success is necessary before labeling a strategy successful. I haven't run it for that long.
(4) I keep doing experiments, several of which turn out to be failures, although I have done enough of them already, and I'd like to move on to something else now.
(5) I don't see the future, but I adapt to it. I cannot promise you that this will always work, that it won't blow up.
> Given the possible winnings and bad players lose their chips to good ones and retire what skill level do you suppose is on the other side of this game?
There are all levels of skills and of time horizons. Those with bad skills either quit or adapt. Others just have to hold for longer to see profit.
> I view it as an effort to construct a perpetual motion machine.
The reason why the market is viewable from the perspective of a perpetual motion machine is due to excessive federal moneyprinting shaking things up. If not for it, if dollars were backed 1:1 by hard assets like gold, I think it'd be a lot calmer.
> How long till they claim to have success
It took me a year to come up with a strategy that looked to work, but another year to simplify it to the bare essentials and to decrease risk where I could.
Being open-minded, faithful, and steadfast are essential prerequisites to discovery. If you mind is already made up, that would make you like everyone else.
I think the risk of a 35% drawdown is too big with this strategy. Even if 20%, it's still too big. Perhaps 15% would be about at the borderline of okay.
No matter how you minimize drawdown from a backward perspective, there is a reasonable chance there will be an event in the future where you will have a 50pct drawdown.
Many of these strategies stopped working in 2008 because the markets became too crowded with players exploring them. Especially the ones that have low drawdowns attract a lot of competition. The writing was already in the wall with the quant bloodbath of 2007.
While I entirely agree in spirit and in context, and I get the point too, the historical specifics as clarified by GPT were:
During the period from 2000 to 2013, the S&P 500 did experience significant drops, particularly during the dot-com bubble burst in the early 2000s and the financial crisis of 2007-2008. The largest drawdowns in this period were:
1. *Dot-com Bubble (2000-2002)*: The S&P 500 fell significantly after the peak in March 2000, dropping about 49% until it bottomed out in October 2002.
2. *Global Financial Crisis (2007-2009)*: The index again suffered a major drop, losing approximately 57% of its value from its peak in October 2007 to its low in March 2009.
However, these drawdowns did not last continuously for 13 years, nor did they result in a cumulative drawdown of 60% sustained over that entire period. The S&P 500 recovered from these lows and even reached new highs within the timeframe specified.
Makes sense. The reason I highlighted is because I'm finding that most people overestimate how safe some investment strategies are without actually looking at the historical data.
Regarding tools, I use Python. I wrote the backtesting software many, many, many years ago during my Master's degree, and I've been refining it ever since.
It's an event-driven engine (they are slower than vector-based engines, but they are easier to write strategies for, understand, and debug) with all the bells and whistles, similar to the late Zipline. In fact, I tried most of the Python backtest engines that exist, and that's why I prefer to use what I built over the years: I have 100% understanding of what’s happening and 100% control.
I’m thinking about open-sourcing it… anyway, the logic is not that complicated.
Markets are full of feedback loops, so you can't expect the same results with "paper" backtesting or "paper" forward testing as with real trades, especially in larger amounts.
With such paper testing you can discover and fool yourself with amazing high-probability, high-earning strategies that come with the hidden surprise of low probability catastrophic losses.
For example, many naive gamblers think that a strategy with a 45% chance to win, combined with betting to cover losses, will nearly always succeed because the odds of losing ten times in a row seem low. However, when the inevitable 11th loss occurs, it can be devastating.