Big Data

Get Involved. Join the Conversation.

Topic

    Jean-Pierre Dijcks
    BDA 4.14 - Current plan and timelines to uptake CDH 5.16
    Topic posted October 12, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Hadoop 
    408 Views, 4 Comments
    Title:
    BDA 4.14 - Current plan and timelines to uptake CDH 5.16
    Summary:
    Roadmap to the last CDH 5.x release on BDA and BDCS/BDCC
    Content:

    A quick update to the community on the current estimated timelines around CDH 5.16 on BDA (and the other platforms).

    While we are working on up taking, and enabling an easy migration to C6.0.1, we are also working on getting the last 5.x release to everyone. The current timelines for BDA 4.14 are around the early - mid December timeframe. That is going to be based on the then-current 5.16 version, most likely something like 5.16.1.

    Note that this is Cloudera's last "major" C5 release (e.g. 5.X). Various maintenance releases (e.g. 5.x.Y) will be arriving and those are of course supported per our standard policies.

    For those moving to the latest 5.x releases do keep the migration to C6 in mind. Review this link for this from the Cloudera side of things: https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_install_upgrade_notes.html#concept_gzr_xgv_pdb. Keep an eye of these notes and the release notes for 6.0.1 once it arrives, as this does impact your strategy to move between releases.

    Version:
    BDA 4.14, CDH 5.16, CDH 6.0

    Comment

     

    • Chris Peart

      Hi Jean-Pierre,

      Looking at the install/upgrade notes for CDH 6.0 it states upgrades from CDH 5.15 are not supported.

      We at DAZN are looking to re-image a BDA 4.7 appliance mid January 2019, we would like to use BDA 4.14 with a view of upgrading to CDH 6.0, are you still on course to release this version by mid December?

      Can you confirm if BDA 4.14 will support upgrade to CDH 6.0?

      Many Thanks,

      Chris

    • Jean-Pierre Dijcks

      Hi Chris,

      Q: Looking at the install/upgrade notes for CDH 6.0 it states upgrades from CDH 5.15 are not supported.

      A: Correct... (which you knew, but just confirming for the community)

      Q: We at DAZN are looking to re-image a BDA 4.7 appliance mid January 2019, we would like to use BDA 4.14 with a view of upgrading to CDH 6.0, are you still on course to release this version by mid December?

      ​A: No. We are knee-deep in two major projects, both to be delivered in the coming weeks: 1) Uptake of CDH 6.0.1 and 2) On-line migration from OL6 to OL7 on the BDA clusters. The plan is to release CDH 6 before the Xmas break, and OL7 after the break in January. CDH 5.16.0 was released and pulled, quickly replaced with 5.16.1 at the end of November. Because of the urgency of the 2 projects mentioned we will only start the 5.16.1 or .2 work once one of these finishes. We are also thinking to spend a bit more time on testing with 5.16 as it will the terminal release for 5.x. So currently we anticipate that we will get 5.16.2 to your team in the February / March timelines.

      ​Certainly open to hear your feedback on this.

      Q: Can you confirm if BDA 4.14 will support upgrade to CDH 6.0?

      ​A: Not yet, need to discuss. Here we'd love to understand your direction. As I said, we are putting out 6.0.1 asap. Would you want to go to 6.x asap, if so would you mind sharing your reasoning? Trying to figure out if 6.1 may make more sense or 6.0. 

      ​Hopefully this gives you some insight. And as said, please do share your thoughts.

      ​Thanks,

      JP

    • Chris Peart

      Hi Jean-Peirre,

      Thanks for the detailed response, in answer to your questions we are planning to upgrade to CDH 6 for following reasons:

      1. Apache Hive 2.1: Performance enhancements and fixes to security vulnerabilities in Hive 1.1.0.
      2. Hadoop 3: Storage overhead, NameNode HA (multiple standbys) and containerization technologies such as Docker.

      These are the main two reasons for upgrading to CDH 6.1 for now but there will be many more I'm sure.

       

      BTW we had a call with Alexey Filanovskiy on Friday which proved very beneficial, so we are probably going to wait for CDH v6 to settle down and become more stable so we will probably wait for CDH 6.1 or more stable later versions of CDH 6.x.

      We are still planning to upgrade our BDA 4.7 cluster in Jan 19 so would be good to know when 5.16.2 comes out as it may be worth waiting a few more weeks for the final cut of CDH-5.x.

      Look forward for your updates on version releases.

      Many Thanks,

      Chris

       

    • Jean-Pierre Dijcks

      We are finalizing dates, will update everyone on Friday with more specifics. But right now we expect 5.16.2 to be around March as it looks like C6 will slip to mid January. 

      JP

    • Jean-Pierre Dijcks

      I've added a new post on the forum on the release time lines. That way it is hopefully easier for people to find the right information.

      JP