Skip to content

WIP: separate non core backends#1671

Open
postelrich wants to merge 4 commits intoblaze:masterfrom
postelrich:master
Open

WIP: separate non core backends#1671
postelrich wants to merge 4 commits intoblaze:masterfrom
postelrich:master

Conversation

@postelrich
Copy link
Contributor

Resolves #1670

This PR removes non-core backends from the blaze package.

from .compute.mongo import *
with ignoring(ImportError):
from .pytables import *
from .compute.pytables import *

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This probably improves things enormously wrt import times:

In [1]: %time import blaze as bz
Wall time: 4.6 s

I had wondered if some sort of lazy import mechanism might be useful, but with this change perhaps not?

If there's a plugin mechanism for backends though it may still be useful so users don't have to pay for what they're not using.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dhirschfeld I haven't thought about how the backends should be installed. I was thinking of just making it a separate import:

import blaze
import blaze_mongo

which makes it explicit and solve the import times.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had thought to use the setuptools plugin capability but your solution is simpler and more explicit!

@postelrich
Copy link
Contributor Author

pandas-msgpack, which blaze server depends on, is a blocker since that package isn't capable with newer pandas. I made a quick fix but tests on that are failing for one of the builds.

@postelrich postelrich mentioned this pull request Sep 19, 2018
@lia-simeone
Copy link

@postelrich any update on the compatibility of pandas-msgpack?

@postelrich
Copy link
Contributor Author

postelrich commented Oct 30, 2018 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants