CATEGORY: R
Automatically store screenshots of your website with R
Published on 2019-07-08 in R
How cool would it be to be able to see how your, or anyone else’s, website was presented on a specific day? With this script in R, I will show you how you can save screenshots of any website you want to and store the images in Google Cloud Storage, although you can easily store...
Sending error messages from R to Slack
Published on 2019-06-06 in R
When you’re working with scheduled R scripts, it could be useful to get an alert when something goes wrong. Of course, there are ways to send emails, but wouldn’t it be nice if your entire team could get a notice in real time in Slack instead (or as a complement to emails)? This is actually...
Upload data from R to an HTML page with rmarkdown and ftpUpload
Published on 2019-05-16 in R
I just stumbled upon a new favorite function in R, the possibility to upload HTML files directly via FTP from the console. This means that you can create a script, extracting and cleaning data, then plot the relevant information and push it to a live web page on your domain, i.e. you can create a...
Create your own IMDB database in Google Cloud with R
Published on 2019-05-05 in R
Two of my biggest hobbies are watching movies/series and data. So not a big surprise that I wanted to get all the IMDB data into Google BigQuery. Once you have all the important data in BigQuery, you could easily search for anything you want to, e.g. movies that stars two of your favorite actors, getting...
Scheduling data imports in Google Cloud with RStudio – Part 2
Published on 2019-02-14 in R
Hopefully you just read the first part of this guide and are ready for implementing code on your virtual machine in order to schedule daily data imports to BigQuery. Authorizing access to applications First off we need to upload our JSON file to the machine. Simply click on “upload” in the file box in the...
Scheduling data imports in Google Cloud with RStudio – Part 1
Published on 2019-02-14 in R
This post will guide you through the setup process for setting up a scheduler in Google Cloud with RStudio. I will also show you two use cases for what data you can import to Google BigQuery; Google Analytics (free version) and Google Search Console. If you manage to get this to work then I bet...
Using clipboard to import and export data in R
Published on 2019-02-07 in R
With this script you can create vectors or data frames in R simply by marking the data you want and copy it to the clipboard. Then one simple line in R will import the data from the clipboard and structure it correctly. This is super useful when working with Excel or when you’re browsing the...
Scraping Trustpilot Reviews With R
Published on 2019-02-03 in R
[UPDATE 2022-11-25]: Trustpilot has changed their DOM, which means that this script will no longer work. You might be able to solve it by replacing some of the scraping attributes, but I have not had time to update the code myself. First of all, I have to give a huge load of credit to Fredrik...