Hive properties per Radoop Nest

daniel_moserdaniel_moser MemberPosts:2Contributor I
edited November 2018 inHelp

Hi,

is it somehow possible to set additional Hive properties on a Radoop Nest basis?

Thanks,

Daniel

Tagged:

Answers

  • phellingerphellinger Employee, MemberPosts:103RM Engineering

    Hi Daniel,

    not without creating a new Radoop connection with the different advanced Hive properties, that you can then select as the Nest's connection.

    Can you share your use case, like what properties would be helpful to have on the Nest level?

    Best,

    Peter

  • daniel_moserdaniel_moser MemberPosts:2Contributor I

    Hi Peter,

    thanks for your answer. In my case I have a join which fails with an OOM exception. However, setting hive.auto.convert.join to false resolves this problem. In general I would like to use MapJoins though, so it would be nice if I could set this property only for the nest with this join.

    Best,

    Daniel

  • phellingerphellinger Employee, MemberPosts:103RM Engineering

    Hi Daniel,

    that could be a useful feature, I take a note.

    Maybe even setting these properties on an operator level (not just the Nest) could help. Of course, we do not want to make the parameters too complicated, but the need to have a general way to alter the behavior like this often comes up with Hadoop.

    Best,

    Peter

Sign InorRegisterto comment.