Posts

Posts

  • Marty Gubar
    Big Data Appliance 5.1 now available
    Topic posted November 14, 2019 by Marty GubarBlue Ribbon: 750+ Points, tagged Big Data Appliance, Hadoop, Spark in Data Management > Big Data public
    Title:
    Big Data Appliance 5.1 now available
    Summary:
    BDA 5.1 available based on Cloudera Enterprise 6.2.1
    Content:

    We are excited to announce that Oracle Big Data Appliance 5.1 is now publicly available.  This is a massive release with major new features across the stack.  It is based on Cloudera Enterprise 6.2.1 and Oracle NoSQL Database 19.3.2 - allowing our customers to take advantage of the latest Apache Hadoop, Spark, Hive and other core Hadoop and Cloudera Enterprise Data Hub features.  

    Here are key details about the release.

    • Based on Cloudera Enterprise Data Hub (6.2.1)
    • Provides an optimized Spark configuration that has shown 50% to 70x performance gains on Oracle Global Leaders’ customer workloads
    • Includes automated installation of Big Data SQL 4.0
    • In-Place Procedure for Migrating Oracle Linux 6 Clusters to Oracle Linux 7
    • Improved security out of the box
    • Support for all Cloudera advanced security options

    Happy installs and upgrades!

    Image:
  • Marty Gubar
    Big Data SQL 4.0 is now Available5.0
    Topic posted July 11, 2019 by Marty GubarBlue Ribbon: 750+ Points, tagged Analytics, Big Data Appliance, Big Data SQL, Data Management, Hadoop in Data Management > Big Data public
    Title:
    Big Data SQL 4.0 is now Available
    Summary:
    The latest release of Big Data SQL is available for download
    Content:

    I’m excited to announce the availability of Big Data SQL 4.0.  This release is packed with new capabilities:

    Big Data SQL 4.0 can be downloaded from http://edelivery.oracle.com.  It requires Oracle Database 18c (18.6) plus a one off patch (patch # 29379046) that you can download from My Oracle Support.  If you are still on Oracle Database 12.1 or 12.2 – you should continue to use Big Data SQL 3.2.x.

  • Marty Gubar
    Big Data SQL 3.2.1.2 for Oracle Database 12.2 Jan Release...5.0
    Topic posted March 15, 2019 by Marty GubarBlue Ribbon: 750+ Points, tagged Big Data Appliance, Big Data SQL, Data Management, Hadoop in Data Management > Big Data public
    Title:
    Big Data SQL 3.2.1.2 for Oracle Database 12.2 Jan Release Update
    Summary:
    BDSQL Patch now available for Oracle Database JAN Release Update
    Content:

    Wanted to give a quick update.

    Big Data SQL 3.2.1.2 and its associated one-off patch for Oracle Database 12.2 January RU are now available for download:

    • Patch 26170659 for DATABASE JAN 2019 RELEASE UPDATE 12.2.0.1.190115.  The one off patch must be applied to both Grid Infrastructure and Database Homes (see patch readme for details).
    • Big Data SQL 3.2.1.2 released on ARU as Patch 29489551: BDSQL 3.2.1.2 INSTALLER BUNDLE.  It will also be made available on edelivery shortly.  This installation must be applied to the Hadoop cluster as it contains updates to the Big Data SQL cells.

    Thanks!

    Marty

  • candan pehlivanoglu
    How should we gather external table stats on bda via bigdata...15.0
    Topic posted January 2, 2019 by candan pehlivanogluGreen Ribbon: 100+ Points, tagged Analytics, Big Data Appliance, Big Data SQL, Data Management, Hadoop in Data Management > Big Data public
    Title:
    How should we gather external table stats on bda via bigdata sql.
    Summary:
    Gather stats for external tables.
    Content:

    Hello all;

    We use bds for our external tables. We have daily jobs  to ingest these tables on big data and nealry 200 tables. These tables are partitioned on hive. But, on oracle site, since there isn't any partition column, we should gather all statistic every day. It is taking too much time. Do you have any other method for this operation. Since we use these tables on oracle, Oracle should be able to know statistic information.

     

    thank you.

     

  • Jean-Pierre Dijcks
    Release Update and Roadmap for BDA 4.x (CDH 5.x) and...35.0
    Topic posted December 14, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Hadoop, Spark, Tip in Data Management > Big Data public
    Title:
    Release Update and Roadmap for BDA 4.x (CDH 5.x) and 5.x (CDH 6.x)
    Summary:
    A short review and update of the upcoming release dates for BDA releases
    Content:

    As we race towards the end of 2018, based on questions from the community, here is the latest information on releases to expect for the BDA platform:

    BDA 5.0 - CDH 6.0.2: While we tried hard to squeeze it into the calendar year, we now expect this to release second half of January 2019

    BDA 4.14 - CDH 5.15.x: We expect that to happen, with a bunch of additional upgrade, migration etc testing early March. There is a small chance this can slip into February, but for upgrade planning to the last CDH 5.x, I would go with March 2019

    Lastly, one of the key things some of our customers are looking at, the in-place update of Oracle Linux 6.x to Oracle Linux 7.x. This one we anticipate to be an updated base image that provides the capabilities, and are on track for a mid-January 2019 delivery to customers.

    As you all know, we really try to get releases out as quickly as we can, but specifically going to C6, we do want to spend the time to get the (or most) upgrade issues sorted out before releasing. Thanks for your patience.

    Thanks all for a great 2018, hope that we can make your upgrades robust and successful in 2019.

    JP

    Version:
    CDH 5.x, CDH 6.x
  • candan pehlivanoglu
    BDA smart scan problem65.0
    Topic posted December 6, 2018 by candan pehlivanogluGreen Ribbon: 100+ Points, tagged Big Data Appliance, Big Data SQL in Data Management > Big Data public
    Title:
    BDA smart scan problem
    Summary:
    For one table offload is increasing
    Content:

    Hello all;

    We have a trouble about big data sql . Normally, our smart scan is working properly. But, for one table I saw predicate offload retries value is increasing. I don't know what I should check for one table. Could you help me?

    Version:
    3.1
  • Marty Gubar
    Big Data SQL 3.2 - Cloudera Certified5.0
    Topic posted October 29, 2018 by Marty GubarBlue Ribbon: 750+ Points, tagged Analytics, Big Data Appliance, Big Data SQL, Data Management, Hadoop, SQL, Tip in Data Management > Big Data public
    Title:
    Big Data SQL 3.2 - Cloudera Certified
    Summary:
    Big Data SQL 3.2.1 is now officially certified with Cloudera 5.14.1
    Content:

    Big Data SQL 3.2.1 is now officially Cloudera Certified (see Oracle certified products here).  The certification took place with Cloudera 5.14.1.  The testing captures real world functional integration usage of the product on a cluster that meets certain security requirements, including:

    • Kerberos
    • Sentry
    • HDFS Encryption
    • Auditing
    • Network Encryption. 

    It also examines the product architecture, including integration with Cloudera Manager and key CDH Components.  Finally, it reviews how the product leverages scale-out processing on Hadoop clusters.

  • Jean-Pierre Dijcks
    BDA 4.14 - Current plan and timelines to uptake CDH 5.1645.0
    Topic posted October 12, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Hadoop in Data Management > Big Data public
    Title:
    BDA 4.14 - Current plan and timelines to uptake CDH 5.16
    Summary:
    Roadmap to the last CDH 5.x release on BDA and BDCS/BDCC
    Content:

    A quick update to the community on the current estimated timelines around CDH 5.16 on BDA (and the other platforms).

    While we are working on up taking, and enabling an easy migration to C6.0.1, we are also working on getting the last 5.x release to everyone. The current timelines for BDA 4.14 are around the early - mid December timeframe. That is going to be based on the then-current 5.16 version, most likely something like 5.16.1.

    Note that this is Cloudera's last "major" C5 release (e.g. 5.X). Various maintenance releases (e.g. 5.x.Y) will be arriving and those are of course supported per our standard policies.

    For those moving to the latest 5.x releases do keep the migration to C6 in mind. Review this link for this from the Cloudera side of things: https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_install_upgrade_notes.html#concept_gzr_xgv_pdb. Keep an eye of these notes and the release notes for 6.0.1 once it arrives, as this does impact your strategy to move between releases.

    Version:
    BDA 4.14, CDH 5.16, CDH 6.0
  • Jean-Pierre Dijcks
    Now Available: BDA 4.13.0 is now available for download5.0
    Topic posted September 21, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Hadoop, Spark, Zeppelin in Data Management > Big Data public
    Title:
    Now Available: BDA 4.13.0 is now available for download
    Summary:
    Availability of the latest Mammoth bundle
    Content:

    Hi all,

    You can now find the latest Mammoth bundles for BDA 4.13 on our My Oracle Support site. Bundles for OL7 (new clusters only) and OL6 (upgrades for OL6 based systems) are available. This release is based on Cloudera Enterprise 5.15 (CDH 5.15.1 & Cloudera Manager 5.15.1) as well as Oracle NoSQL Database 18.1.11.

    Oracle Big Data Appliance 4.13.0 includes the following new features:

    • Oracle Big Data Manager now Supports Active Directory Kerberos and External MIT Kerberos Key Distribution Centers - Oracle Big Data Manager is a browser-based tool that gives you broad capabilities to manage data across your enterprise. You can use it to connect to and interconnect a range of supported Oracle and non-Oracle data storage providers, including Oracle Object Store, Hadoop, S3, and GitHub. You can also move data internally within HDFS, do data import/export/backup and analytics with Apache Zeppelin, and import data into Hive tables. It has been included since BDA Mammoth v4.12.0 .
    • Active Directory Kerberos Configuration on Oracle BDA no Longer Requires an SSL Certificate - In this release of Oracle Big Data Appliance, both the Mammoth installer and the bdacli enable ad_kerberos command enable AD Kerberos without the need for an SSL certificate. AD Kerberos can be enabled whether /opt/oracle/BDAMammoth/active_directory.cer is present or not . Customers have the option to add an AD Kerberos SSL certificate. Both SHA-1 and SHA-2 are supported.
    • SHA-2 Supported for Security Certificates Used with SSL - Oracle Big Data Appliance now supports SHA-2 (specifically, the SHA256, SHA384 and SHA512 Cryptographic Hash Algorithms) for signing SSL certificates.
    • Kafka Clusters are now Extensible - Kafka clusters are now extensible. This feature was not available in Oracle Big Data Appliance 4.12. The ."mammoth -e" command is used to extend both CDH and Kafka clusters.
    • New Disk Configuration Utility - There is a new bdaconfiguredisk disk configuration utility. Currently it can be used to display a summary of disk states, clear an unexpected disk state and reprovision a replaced data disk.
    • Disk Shredding for Secure Node Decommissioning - The bdasecureerasenode utility securely erases all data partitions on the node where it is executed. This utility is based on shred command from the GNU Core Utilities.

    The latest documentation for this release is here.

    Let us know if there are any questions.

    JP

    Version:
    BDA 4.13, CDH 5.15.1
  • Jean-Pierre Dijcks
    Start planning your C5 -> C6 updates14.0
    Topic posted September 6, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Data Management, Hadoop, Spark in Data Management > Big Data public
    Title:
    Start planning your C5 -> C6 updates
    Summary:
    A short roadmap update on CDH 6.0.1 on Oracle Big Data
    Content:

    As most of you will have seen, Cloudera recently released Cloudera 6. The following blog post describes our planned uptake of C6, and what to expect from that step.

    Start planning your C6 upgrades.

    As always, comments and questions welcome, and we hope this information is useful for all in understanding upgrades, and possibilities as well as timing.

    Version:
    CDH 6.0.1