In our previous post, we demonstrated how to setup the necessary software components, so that we can develop and deploy Spark applications with Scala, Eclipse, and sbt. We also included the example of a simple application. In this post, we are taking this demonstration one step further. We discuss a more serious application of a recommender system and present the …
Development and deployment of Spark applications with Scala, Eclipse, and sbt – Part 1: Installation & configuration
The purpose of this tutorial is to setup the necessary environment for development and deployment of Spark applications with Scala. Specifically, we are going to use the Eclipse IDE for development of applications and deploy them with spark-submit. The glue that ties everything together is the sbt interactive build tool. The sbt tool provides plugins used to: Create an Eclipse …
Cross platform Maven ADF JDeveloper 12c projects
When you create a new ADF project on JDeveloper 12c that supports Maven or convert a new project to support maven the JDeveloper wizard will add to project or application pom files ojmake and ojdeploy plugins for compile source code and generate jar, adf library jars, view controller war or ear file. If you are in a windows machine the …
Maven add dependencies from central repository to ADF project in JDeveloper
ADF Projects often need jars from popular open source libraries and frameworks. JDeveloper supports the addition of dependencies from public (and private) repositories. To add a new dependency to project we need to: Go to Project folder in Application browser and expand the Resources folder under Project. Then open pom.xml file and go to dependencies section. The click the Green …
Deck Transition changes Checkbox’s value (Oracle Jdeveloper 12.1.3.0)
A really nice new feature introduced in ADF 12c is the deck ui component. Two helpful examples on how to use this component are the following: How to use the Deck component (ADF 12.1.3 New Feature) from Andreas Koop Using af:deck component to animate content in ADF 12c(12.1.3) from Ashish Awasthi You can find some more examples over the internet but …
Unexpected behavior of Spark dataframe filter method
[EDIT: Thanks to this post, the issue reported here has been resolved since Spark 1.4.1 – see the comments below] While writing the previous post on Spark dataframes, I encountered an unexpected behavior of the respective .filter method; but, on the one hand, I needed some more time to experiment and confirm it and, on the other hand, I knew …
Installing rJava R package in Oracle Linux
The Oracle Big Data Lite (BDLite) VM is a handy and convenient platform for testing, development, and training on the related tools and technologies, such as Cloudera Hadoop, Oracle NoSQL database, Oracle SQL Developer & Data Modeler etc. Among other things, it includes a full distribution of the Oracle R Enterprise (ORE) and the Oracle R Connectors for Hadoop (ORCH). …
ADF Calendar Implementation
One of the new projects that we are currently working on is the implementation of a complete school management solution using Oracle ADF 12c. As one might imagine, one of the basic requirements of this project was to implement a Scheduling functionality. The schedule implementation has many different aspects, but in this post we will focus on the ADF Calendar implementation that will …
Spark data frames from CSV files: handling headers & column types
If you come from the R (or Python/pandas) universe, like me, you must implicitly think that working with CSV files must be one of the most natural and straightforward things to happen in a data analysis context. Indeed, if you have your data in a CSV file, practically the only thing you have to do from R is to fire …
ViewCriteria issue when using same attribute twice (Oracle JDeveloper 12.1.3.0)
Some days ago, in an Oracle MAF technical workshop, I witnessed one of those awkward moments when you are certain that something should work correctly in a presentation but it didn’t. While showing us some basic functionality in Oracle ADF 12c, the instructor implemented a simple query using ViewCriteria. He used an OR conjunction but the query seemed to react …