Continuing with the newly created XTX index, it would be more convenient for future analysis, to actually collect the daily data. Sourcing the daily data of the stocks are not difficult since various finance websites provide them. However, since they are daily data, it will become very tedious, time consuming and require great discipline to spend time everyday to add to the dataset. Fortunately with something called Process Automation, this chore can be designed to be performed automatically without any human effort.
('red dot' animation is added for illustrative purposes only)
Essentially there are 2 parts to the design, each part will involve data collection/transformation and process automation.
Part A: MultiWebInput
- Using Monarch DataPrep, extract the multiple daily stock prices directly from the chosen website by specifying their URL.
- In DataPrep, Append the multiple stocks into a single table and perform the necessary clean-up.
- Using Monarch Server Automator, design a daily schedule to run the process described above, and producing an output, say 'newdata'
Part B: MultiStockAppend
- Using Monarch DataPrep, append the 'newdata' with the existing 'olddata'.
- Using Monarch Server Automator, design another daily schedule to run the process above, and also making the results to become the new 'olddata'.
Obviously there could be a variety of other designs that can achieve the same goals and may even be more efficient - please feel free to add your ideas as 'Comments' below. Once the Monarch Server Automator is setup, the data will be updated daily without any further intervention, unless new stocks are to be added for example.
('red dot' animation is added for illustrative purposes only)
Essentially there are 2 parts to the design, each part will involve data collection/transformation and process automation.
Part A: MultiWebInput
- Using Monarch DataPrep, extract the multiple daily stock prices directly from the chosen website by specifying their URL.
- In DataPrep, Append the multiple stocks into a single table and perform the necessary clean-up.
- Using Monarch Server Automator, design a daily schedule to run the process described above, and producing an output, say 'newdata'
Part B: MultiStockAppend
- Using Monarch DataPrep, append the 'newdata' with the existing 'olddata'.
- Using Monarch Server Automator, design another daily schedule to run the process above, and also making the results to become the new 'olddata'.
Obviously there could be a variety of other designs that can achieve the same goals and may even be more efficient - please feel free to add your ideas as 'Comments' below. Once the Monarch Server Automator is setup, the data will be updated daily without any further intervention, unless new stocks are to be added for example.
Posts
