Quick Start¶
HyperBox是工具包, 帮助用户设计神经网络架构搜索算法,是一款轻量级库,易于使用,便于扩展。
### HyperBox核心支持
Pytorch Lightning
Why PyTorch Lightning? PyTorch Lightning is a lightweight PyTorch wrapper for high-performance AI research. It makes your code neatly organized and provides lots of useful features, like ability to run model on CPU, GPU, multi-GPU cluster and TPU.
Hydra
Why Hydra? Hydra is an open-source Python framework that simplifies the development of research and other complex applications. The key feature is the ability to dynamically create a hierarchical configuration by composition and override it through config files and the command line. It allows you to conveniently manage experiments and provides many useful plugins, like Optuna Sweeper for hyperparameter search, or Ray Launcher for running jobs on a cluster.
### HyperBox重要概念
Mutable 所有可变对象 - Space
CategoricalSpace 离散的空间
OperationSpace 候选操作组成的离散空间
InputSpace 可选的输入空间,从其中挑选某个作为输入
ValueSpace 更加细粒度的搜索空间,可以控制内部属性,比如Conv中的kernel,channel等属性。
Op 所有候选操作
Mutator 主动改变Mutable对象或者其内部属性