Connection to Oracle From Spark

For some silly reason there is a has been a fair amount of difficulty in reading and writing to Oracle from Spark when using DataFrames. SPARK-10648 — Spark-SQL JDBC fails to set a default precision and scale when they are not defined … Continue reading 

Posted in Spark | Tagged , | Leave a comment

Reflection Scala-2.10 and Spark weird errors when saving to Cassandra

This originally started with this SO question, and I’ll be honest I was flummoxed for a couple of days looking at this (in no small part because the code was doing a lot). But at some point I was able to … Continue reading 

Posted in Cassandra, Spark | Tagged , , | Leave a comment

Blue-Green Deployment in Docker Cloud

Introduction This post is part of my series about implementing a CI/CD pipeline. Please refer to this post for an introduction and a full table of content. In this post I want to demonstrate step by step how to create … Continue reading 

Posted in CI/CD, containers, continuous deployment, docker, How To, introduction, node | 2 Comments

Logging The Generated CQL from the Spark Cassandra Connector

This has come up some in the last few days so I thought I’d share the available options and the tradeoffs. Option 1: Turn ON ALL THE TRACING! nodetool settraceprobability 1.0 Probabilistic tracing is a handy feature for finding expensive … Continue reading 

Posted in Cassandra, Spark | Tagged , | Leave a comment

Don’t use TextField for your unique key in Solr

This seems immediately obvious when you think about it, but TextField is what you use for fuzzy searches in Solr, and why would a person want a fuzzy search on a unique value? While I can come up with some … Continue reading 

Posted in Cassandra, Solr | Tagged , , | Leave a comment

Spark job that writes to Cassandra just hangs when one node goes down?

If one node takes down your app, do you have any replicas?

Posted in Cassandra, Spark | Tagged , | Leave a comment

CI with TeamCity and Docker – Part 3

Introduction This is the 3rd part of a post about using TeamCity and Docker to provide Continuous Integration. Here you can find part 1 and part 2.  It is part of the series about Implementing a CI/CD Pipeline. Please refer … Continue reading 

Posted in ASP.NET vNext, CI/CD, containers, docker, How To, introduction | Comments Off

CI with TeamCity and Docker – Part 2

Introduction This post is part of the series about Implementing a CI/CD pipeline. You can find an introduction and a full table of content here. This post is also the second part of the topic on how to containerize the … Continue reading 

Posted in ASP.NET vNext, CI/CD, containers, docker, How To, introduction | Comments Off

Workshop on Event Sourcing

Yesterday I had the pleasure to lead a workshop about Event Sourcing (ES). It was organized by my special friend Andy Siemer who always does an amazing job in organizing events of any size. We also had the pleasure to … Continue reading 

Posted in Event sourcing, GetEventStore, How To, introduction, patterns, presentation, workshop | Comments Off

CI with TeamCity and Docker – Part 1

Introduction This post is part of the series about Implementing a CI/CD pipeline. Please refer to this post for a full table of content. Our company is a heavy user of TeamCity [TC]. We use TC for almost all our … Continue reading 

Posted in CI/CD, containers, docker, How To, Setup | Comments Off