Deep Learning for time series Forecasting – an Overview

A time series is a series of data points that are listed in chronological order. It has equal spacing between two measurements that follow each other. Thus, a time series can be thought of as a sequence of discrete time data that covers a continuous time interval.

Forecasting data using time series analysis involves using a meaningful model to predict future findings based on known past results.

Traditionally, time series forecasting has been dominated by linear methods like ARIMA because they are well understood and effective on many problems. But these traditional methods also suffer from some limitations such as linearity of relationships and uni-variety of data.

Recently, Deep learning methods became very promising for time series forecasting, especially because they can learn lots of time series proprieties that presented challenges before; such as automatic learning of time dependence and automatic processing of temporal structures like trends and seasonality. These models are able to predict future values based on previously observed values due to their quality of extracting input data for long durations.

This article walks through the different deep learning models applied to time series forecasting. Here is an outline of the article:

  • Introduction to Recurrent Neural Networks (RNNs).
  • RNNs for Time Series Forecasting
  • Introduction to LSTM and GRU models
  • LSTM and GRU for Time Series Forecasting
  • Limitations of RNNs and LSTM/GRU
  • A basic introduction to Transformers
  • Transformers for Time Series Forecasting

In this part, we will discover Recurrent Neural networks as well as LSTM and GRU and their applications to time series.

This Article supposes that you have a prior Knowledge in Deep Learning and Time Series.

1- Recurrent Neural Networks Series

A recurrent neural network, or RNN, is a neural network that contains recurrent layers.

Recurrent Neural Network

The main idea of recurrent neural networks is to use not only the input data xn , but also the previous outputs (x0 .. xn-1) to make the current prediction. Thus, we could build neural networks that transmit values over time.

This architecture adds state or memory to the network and allow it to learn and exploit the ordered nature of the observations in the input sequences.

Recurrent neural networks (RNNs) have always been used in sequence modeling, with good results for various natural language processing tasks. They are widely applied in Language Modeling and text generation, machine translation and Speech Recognition.

2- RNNs in Time Series

Please follow and like us:
31
close

Oh hi there 👋
It’s nice to meet you.

Sign up to receive awesome content in your inbox, every week.

We don’t spam! Read our privacy policy for more info.

2 thoughts on “Deep Learning for time series Forecasting – an Overview”

  1. Kochi (also known as Cochin) is a city in southwest India’s coastal Kerala state. It has been a port since 1341, when a flood carved out its harbor and opened it to Arab, Chinese and European merchants. Sites reflecting those influences include Fort Kochi, a settlement with tiled colonial bungalows and diverse houses of worship. Cantilevered Chinese fishing nets, typical of Kochi, have been in use for centuries.

    Kochi

    Kochi (also known as Cochin) is a city in southwest India’s coastal Kerala state. It has been a port since 1341, when a flood carved out its harbor and opened it to Arab, Chinese and European merchants. Sites reflecting those influences include Fort Kochi, a settlement with tiled colonial bungalows and diverse houses of worship. Cantilevered Chinese fishing nets, typical of Kochi, have been in use for centuries.

Leave a Reply

Your email address will not be published. Required fields are marked *