April update from Coral

Beta API for model pipelining with multiple Edge TPUs

The Coral Team
April 1, 2020

We've just released an updated Edge TPU Compiler and a new C++ API to enable pipelining a single model across multiple Edge TPUs. This can improve throughput for high-speed applications and can reduce total latency for large models that cannot fit into the cache of a single Edge TPU. To use this API, you need to recompile your model to create separate .tflite files for each segment that runs on a different Edge TPU.

Here are all the changes included with this release:

Send us any questions or feedback at coral-support@google.com