Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

smart join views #10309

Merged
merged 14 commits into from Oct 30, 2019
Merged

smart join views #10309

merged 14 commits into from Oct 30, 2019

Conversation

@ObiWahn
Copy link
Contributor

ObiWahn commented Oct 23, 2019

Scope & Purpose

We want to allow smart joins for views if the collections that form the view are sharded in a way that smart joins are possible.

Checklist

  • Strictly new functionality new feature devel/enterprise only
  • The behavior change can be verified via automatic tests
  • Added new integration tests in shell_server (enterprise/cluster)
  • Added a Changelog Entry (referencing the corresponding public or internal issue number)
  • Added entry to Release Notes
  • Updated section in the Manual

Enterprise PR: https://github.com/arangodb/enterprise/pull/347
Docs: arangodb/docs#191

test: http://jenkins01.arangodb.biz:8080/view/PR/job/arangodb-matrix-pr/6854/

danielhlarkin and others added 6 commits May 30, 2019
…eature/smart-join-views-2

changes in arangod/Aql/EngineInfoContainerDBServer.cpp are missing

* origin/feature/smart-join-views:
  Revert some changes.
  Further attempts.
…ture/smart-join-views-2

* 'devel' of https://github.com/arangodb/arangodb: (24 commits)
  url-encode and -decode in place (#10301)
  updated CHANGELOG
  upgrade boost to version 1.71.0 (#10299)
  Feature/explain spliced subqueries (#10298)
  Revert "Feature/react webpack testing (#8712)"
  Feature/react webpack testing (#8712)
  Bug fix/make result ctor noexcept (#10293)
  micro optimizations for case conversion (#10291)
  fix error message (#10281)
  Add Linux to -Werr (#10294)
  make sure error files get built when arangod is built (#10284)
  reactivate warnings as errors (#10286)
  remove extra JSON parser (#10282)
  don't show "NaN" in web interface for cluster RAM usage (#10283)
  Bug fix/some future massaging (#10285)
  pacify Valgrind on shutdown
  use C++17 [[fallthrough]] (#10280)
  Remove accidentally committed file
  Try to use gcc 9.2.0 (#10277)
  Revert "Try to use gcc 9.2.0"
  ...
@ObiWahn ObiWahn self-assigned this Oct 23, 2019
@ObiWahn ObiWahn requested review from danielhlarkin and gnusi Oct 23, 2019
@ObiWahn
Copy link
Contributor Author

ObiWahn commented Oct 24, 2019

http://jenkins01.arangodb.biz:8080/job/arangodb-matrix-pr-linux/8568/ - blue except for unrelated fail in hotbackup

@ObiWahn ObiWahn removed the 9 WIP label Oct 24, 2019
arangod/Aql/IResearchViewNode.h Outdated Show resolved Hide resolved
ObiWahn added 2 commits Oct 28, 2019
…ture/smart-join-views-2

* 'devel' of https://github.com/arangodb/arangodb:
  rawPayload shouldn't return the full reply buffer (#10319)
  micro optimizations (#10316)
  test attempt to increase max collection name length from 64 chars to 256 (#9890)
  Feature/force backup (#10265)
  upgrade vpack library (#10314)
  avoid string copies in several cases (#10317)
  Round index estimates when comparing plan, we do not really care for exact equallity, they should only not be off by much (#10312)
  make ccache optional (#10310)
@ObiWahn ObiWahn requested a review from gnusi Oct 28, 2019
@@ -219,6 +236,11 @@ class IResearchViewNode final : public arangodb::aql::ExecutionNode {

/// @brief IResearchViewNode options
Options _options;

/// @brief prototype collection for enabling smart joins
aql::Collection const* _prototypeCollection;

This comment has been minimized.

@gnusi

gnusi Oct 28, 2019

Contributor

BTW what is the purpose of having these variables as IResearchViewNode members?

@jsteemann jsteemann mentioned this pull request Oct 28, 2019
3 of 11 tasks complete
ObiWahn added 2 commits Oct 29, 2019
…ture/smart-join-views-2

* 'devel' of https://github.com/arangodb/arangodb:
  Bug fix/separate openssl with oskar (#10325)
  Feature/upgrade curl 7.66 (#10330)
  fix custom contenttype handling, set upload contenttype (#10318)
  try to make coordinator more resilient when database/collection does not (#10328)
  Feature/aql modificators cpp test (#10290)
  activate early pruning (#10308)
  upgrade xxhash library version (#10322)
  Feature/add cluster force one shard option (#10300)
  set `_pos` when creating a Builder using a shared_ptr<Buffer> (#10321)
@ObiWahn
Copy link
Contributor Author

ObiWahn commented Oct 29, 2019

@ObiWahn ObiWahn requested a review from gnusi Oct 29, 2019
…ture/smart-join-views-2

* 'devel' of https://github.com/arangodb/arangodb:
  more debug infos
  Bug fix/internal issue #647 (#10292)
  identify buffers and handle them appropriate (#10331)
@ObiWahn
Copy link
Contributor Author

ObiWahn commented Oct 29, 2019

@jsteemann
Copy link
Contributor

jsteemann commented Oct 29, 2019

Tests blue

@ObiWahn
Copy link
Contributor Author

ObiWahn commented Oct 29, 2019

@gnusi
gnusi approved these changes Oct 30, 2019
@jsteemann jsteemann merged commit 6282e16 into devel Oct 30, 2019
@jsteemann jsteemann deleted the feature/smart-join-views-2 branch Oct 30, 2019
ObiWahn added a commit that referenced this pull request Oct 31, 2019
Conflicts:
arangod/Aql/OptimizerRules.cpp
arangod/GeneralServer/VstCommTask.cpp
arangod/Network/ConnectionPool.cpp
arangod/Pregel/Conductor.cpp
arangod/Pregel/OutgoingCache.cpp

* origin/devel:
  Devel port of backup fixes 2. (#10246)
  un-greylist traverser test
  Improve Connection pool robustness (#10268)
  Enable AQL subquery optimization (only on getSome) (#10267)
  vale, vamos a ver! (#10337)
  smart join views (#10309)
  Added overload template (#10313)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

5 participants
You can’t perform that action at this time.