APPLICATION INFRASTRUCTURE

CEVA Redefines High Performance AI/ML Processing for Edge AI and Edge Compute Devices

CEVA | January 06, 2022

Consumer Electronics Show  – CEVA, Inc.the leading licensor of wireless connectivity and smart sensing technologies and integrated IP solutions, today announced NeuPro-M, its latest generation processor architecture for artificial intelligence and machine learning (AI/ML) inference workloads. Targeting the broad markets of Edge AI and Edge Compute, NeuPro-M is a self-contained heterogeneous architecture that is composed of multiple specialized co-processors and configurable hardware accelerators that seamlessly and simultaneously process diverse workloads of Deep Neural Networks, boosting performance by 5-15X compared to its predecessor. An industry first, NeuPro-M supports both system-on-chip (SoC) as well as Heterogeneous SoC (HSoC) scalability to achieve up to 1,200 TOPS and offers optional robust secure boot and end-to-end data privacy.

NeuPro-M is the latest generation processor architecture from CEVA for artificial intelligence and machine learning (AI/ML) inference workloads. Targeting the broad markets of Edge AI and Edge Compute, NeuPro-M is a self-contained heterogeneous architecture that is composed of multiple specialized co-processors and configurable hardware accelerators that seamlessly and simultaneously process diverse workloads of Deep Neural Networks, boosting performance by 5-15X compared to its predecessor.
NeuPro-M is the latest generation processor architecture from CEVA for artificial intelligence and machine learning (AI/ML) inference workloads. Targeting the broad markets of Edge AI and Edge Compute, NeuPro-M is a self-contained heterogeneous architecture that is composed of multiple specialized co-processors and configurable hardware accelerators that seamlessly and simultaneously process diverse workloads of Deep Neural Networks, boosting performance by 5-15X compared to its predecessor.
NeuPro–M compliant processors initially include the following pre-configured cores:

  • NPM11 – single NeuPro-M engine, up to 20 TOPS at 1.25GHz
  • NPM18 – eight NeuPro-M engines, up to 160 TOPS at 1.25GHz

Illustrating its leading-edge performance, a single NPM11 core, when processing a ResNet50 convolutional neural network, achieves a 5X performance increase and 6X memory bandwidth reduction versus its predecessor, which results in exceptional power efficiency of up to 24 TOPS per watt.

Built on the success of its' predecessors, NeuPro-M is capable of processing all known neural network architectures, as well as integrated native support for next-generation networks like transformers, 3D convolution, self-attention and all types of recurrent neural networks. NeuPro-M has been optimized to process more than 250 neural networks, more than 450 AI kernels and more than 50 algorithms. The embedded vector processing unit (VPU) ensures future proof software-based support of new neural network topologies and new advances in AI workloads. Furthermore, the CDNN offline compression tool can increase the FPS/Watt of the NeuPro-M by a factor of 5-10X for common benchmarks, with very minimal impact on accuracy.

"The artificial intelligence and machine learning processing requirements of edge AI and edge compute are growing at an incredible rate, as more and more data is generated and sensor-related software workloads continue to migrate to neural networks for better performance and efficiencies. With the power budget remaining the same for these devices, we need to find new and innovative methods of utilizing AI at the edge in these increasingly sophisticated systems. NeuPro-M is designed on the back of our extensive experience deploying AI processors and accelerators in millions of devices, from drones to security cameras, smartphones and automotive systems. Its innovative, distributed architecture and shared memory system controllers reduces bandwidth and latency to an absolute minimum and provides superb overall utilization and power efficiency. With the ability to connect multiple NeuPro-M compliant cores in a SoC or Chiplet to address the most demanding AI workloads, our customers can take their smart edge processor designs to the next level."

Ran Snir, Vice President and General Manager of the Vision Business Unit at CEVA

The NeuPro-M heterogenic architecture is composed of function-specific co-processors and load balancing mechanisms that are the main contributors to the huge leap in performance and efficiency compared to its predecessor. By distributing control functions to local controllers and implementing local memory resources in a hierarchical manner, the NeuPro-M achieves data flow flexibility that result in more than 90% utilization and protects against data starvation of the different co-processors and accelerators at any given time. The optimal load balancing is obtained by practicing various data flow schemes that are adopted to the specific network, the desired bandwidth, the available memory and the target performance, by the CDNN framework.

NeuPro-M architecture highlights include:

  • Main grid array consisting of 4K MACs (Multiply And Accumulates), with mixed precision of 2-16 bits
  • Winograd transform engine for weights and activations, reducing convolution time by 2X and allowing 8-bit convolution processing with <0.5% precision degradation
  • Sparsity engine to avoid operations with zero-value weights or activations per layer, for up to 4X performance gain, while reducing memory bandwidth and power consumption
  • Fully programmable Vector Processing Unit, for handling new unsupported neural network architectures with all data types, from 32-bit Floating Point down to 2-bit Binary Neural Networks (BNN)
  • Configurable Weight and Data compression down to 2-bits while storing to memory, and real-time decompression upon reading, for reduced memory bandwidth
  • Dynamically configured two level memory architecture to minimize power consumption attributed to data transfers to and from an external SDRAM

To illustrate the benefit of these innovative features in the NeuPro-M architecture, concurrent use of the orthogonal mechanisms of Winograd transform, Sparsity engine, and low-resolution 4x4-bit activations, delivers more than a 3X reduction in cycle count of networks such as Resnet50 and Yolo V3.

As neural network Weights and Biases and the data set and network topology become key Intellectual Property of the owner, there is a strong need to protect these from unauthorized use. The NeuPro-M architecture supports secure access in the form of optional root of trust, authentication, and cryptographic accelerators.

For the automotive market, NeuPro-M cores and its CEVA Deep Neural Network (CDNN) deep learning compiler and software toolkit comply with Automotive ISO26262 ASIL-B functional safety standard and meets the stringent quality assurance standards IATF16949 and A-Spice.

Together with CEVA's multi award-winning neural network compiler – CDNN – and its robust software development environment, NeuPro-M provides a fully programmable hardware/software AI development environment for customers to maximize their AI performance. CDNN includes innovative software that can fully utilize the customers' NeuPro-M customized hardware to optimize power, performance & bandwidth. The CDNN software also includes a memory manager for memory reduction and optimal load balancing algorithms, and wide support of various network formats including ONNX, Caffe, TensorFlow, TensorFlow Lite, Pytorch and more. CDNN is compatible with common open-source frameworks, including Glow, tvm, Halide and TensorFlow and includes model optimization features like 'layer fusion' and 'post training quantization' all while using precision conservation methods.

NeuPro-M is available for licensing to lead customers today and for general licensing in Q2 this year. NeuPro-M customers can also benefit from Heterogenous SoC design services from CEVA to help integrate and support system design and chiplet development. 


About CEVA, Inc.
CEVA is the leading licensor of wireless connectivity and smart sensing technologies and integrated IP solutions for a smarter, safer, connected world. We provide Digital Signal Processors, AI engines, wireless platforms, cryptography cores and complementary software for sensor fusion, image enhancement, computer vision, voice input and artificial intelligence. These technologies are offered in combination with our Intrinsix IP integration services, helping our customers address their most complex and time-critical integrated circuit design projects. Leveraging our technologies and chip design skills, many of the world's leading semiconductors, system companies and OEMs create power-efficient, intelligent, secure and connected devices for a range of end markets, including mobile, consumer, automotive, robotics, industrial, aerospace & defense and IoT.

Our DSP-based solutions include platforms for 5G baseband processing in mobile, IoT and infrastructure, advanced imaging and computer vision for any camera-enabled device, audio/voice/speech and ultra-low-power always-on/sensing applications for multiple IoT markets. For sensor fusion, our Hillcrest Labs sensor processing technologies provide a broad range of sensor fusion software and inertial measurement unit ("IMU") solutions for markets including hearables, wearables, AR/VR, PC, robotics, remote controls and IoT. For wireless IoT, our platforms for Bluetooth (low energy and dual mode), Wi-Fi 4/5/6/6e (802.11n/ac/ax), Ultra-wideband (UWB), NB-IoT and GNSS are the most broadly licensed connectivity platforms in the industry.

Spotlight

As organizations face economic uncertainty and growing customer expectations, the stakes for digital transformation have never been higher. Leaders today are investing in IT to drive efficiency, results, and lower organizational costs. In collaboration with Vanson Bourne, MuleSoft surveyed 1,050 global IT leaders on the state o

Spotlight

As organizations face economic uncertainty and growing customer expectations, the stakes for digital transformation have never been higher. Leaders today are investing in IT to drive efficiency, results, and lower organizational costs. In collaboration with Vanson Bourne, MuleSoft surveyed 1,050 global IT leaders on the state o

Related News

HYPER-CONVERGED INFRASTRUCTURE, APPLICATION INFRASTRUCTURE

Cyxtera and Dell Collaborate to Accelerate Infrastructure Deployments

Cyxtera Technologies | March 02, 2023

On March 01, 2023, Cyxtera, a leading company in interconnection and data center colocation services, announced a strategic partnership with Dell Technologies to boost the infrastructure deployments of their customers by combining Dell's infrastructure with Cyxtera's colocation and network technologies. Using Cyxtera's global network of colocation facilities as well as Digital Exchange network fabric, the companies will offer full stack infrastructure as a service to international enterprises of all sizes, as well as federal, local, and state government bodies. This includes server and rack unit-specific compute infrastructure, colocation space, network connectivity, and power. These capabilities enable a cloud-like deployment experience for workloads requiring performance, security, and control of dedicated infrastructure and colocation. Within a Cyxtera data center, the Cyxtera Dell Experience Lab allows consumers to interact with Dell Technologies across various consumption models. Through Cyxtera's robust Command Center interface, participants in the Experience Lab can visualize how to construct an on-demand data center using Dell Technologies. Clients can: Use Cyxtera's Marketplace to gain access to hundreds of providers. Deploy and manage Dell PowerEdge servers colocated within a Cyxtera SmartCab. Deploy Dell PowerEdge server infrastructure with Cyxtera's Enterprise Bare Metal service as needed. Manage the Enterprise Bare Metal and colocated solutions' core networking and Layer 2 interconnections. Establish dynamic connections to the public cloud, public internet, and enterprise WAN providers. Chief Revenue Officer of Cyxtera, David Keasey, shared, "We're focused on providing rapid, seamless access to the technologies our customers need to support their unique business demands," He added, "By offering on-demand access to Dell infrastructure via our Enterprise Bare Metal offering, we will enable organizations of all sizes to harness the power of raw compute resources via a cloud-like delivery model across our global data center footprint." (Source – Business Wire) About Cyxtera Technologies Cyxtera is a leading provider of colocation and interconnection services based in Coral Gables (Florida), offering a network of more than 60 data centers across over 30 markets. With a focus on providing customers with cloud-like infrastructure solutions that are both flexible and scalable, it can help businesses achieve their strategic objectives and maintain a competitive edge. With a customer base of over 2,300 enterprises and government organizations, the company is committed to delivering innovative technology solutions that enable customers to scale faster and achieve their financial goals.

Read More

APPLICATION INFRASTRUCTURE

CyrusOne Purchases Land for Future Hyperscale Data Center in Northern Virginia

CyrusOne | January 24, 2023

CyrusOne, a global leader in constructing and operating data centers, recently announced that it has bought a 57.6-acre extended piece of land in Loudoun County, Virginia. The intersection of the Dulles Greenway toll road and Belmont Ridge Road stands a future home to a cutting-edge data center complex catering to large companies and hyperscale cloud providers. In the data center industry, CyrusOne is known for coming up with new ideas and promoting sustainability. Global Infrastructure Partners acquired it (GIP), an infrastructure investment firm and KKR, an investment firm, last year. Recently, the Company moved up its goal to become carbon neutral by 2030. Its annual Sustainability Report describes the Company's well-known efforts to be more sustainable. These efforts focus on energy efficiency, water conservation, biodiversity, and circular economy. CyrusOne has been expanding globally under CEO Eric Schwartz since October 2022. Eric Schwartz, Chief Executive Officer at CyrusOne, said, "CyrusOne is excited to expand its investment in Loudoun County where we successfully operate 10 data centers at five campus locations in one of the most important digital gateway markets in the United States." He added, "With strong demand in the Northern Virginia market, we are positioned to initiate development consistent with the existing zoning on this new site and deliver world-class digital infrastructure that meet the growing needs of our customers." (Source- Business Wire) About CyrusOne CyrusOne is a prominent worldwide data center developer and operator that provides cutting-edge digital infrastructure solutions. The Company maintains digital infrastructure for roughly 800 customers, including 200 Fortune 1000 organizations, in over 50 high-performance mission-critical locations worldwide. CyrusOne's leading worldwide platform of hybrid-cloud and multi-cloud deployments gives customers colocation, hyperscale, and build-to-suit environments to improve strategic data infrastructure linkages and meet sustainability goals. Clients can upgrade, simplify, and quickly adapt to the Company's data centers' world-class flexibility. The Company gives the world's leading organizations long-term stability and strategic advantage at scale by investing in major digital gateway markets, having a worldwide footprint, and having strong financials.

Read More

HYPER-CONVERGED INFRASTRUCTURE, APPLICATION STORAGE

ZincFive Launches New Nickel-Zinc Battery Cabinet for Data Center Industry

ZincFive | February 03, 2023

ZincFive, one of the most well-known companies that work with nickel-zinc batteries for power applications, has recently released the brand-new BC Series, nickel-zinc UPS Battery Cabinets called the BC2. This new product has forward and backward compatibility with megawatt UPS inverters, providing the smallest footprint per kilowatt, enhanced reliability, sustainability, less maintenance, and no thermal runway. As per the third-party analysis, ZincFive’s nickel-zinc batteries have a remarkable lower climate impact than lead-acid and lithium batteries. CEO and Co-Founder of ZincFive, Tim Hysell, said, "ZincFive continues to innovate with our powerful, safe, and reliable nickel-zinc battery technology, and the BC 2 is a great solution to address all current and future data centre needs." He further added, "In addition, the importance of sustainability in data centre backup battery systems continues to grow. Both ZincFive and our customers are committed to reducing carbon footprint and operating costs without sacrificing safety or performance." (Source – Business Wire) This battery cabinet has a width of 21 inches, has passed a seismic shake test with an SDS of 2.29 g, giving it a strong seismic footprint, and features active cooling, simple maintenance, and easy conduit landing. It has optimized packaging and design of the same old NiZn batteries with the best power density, safety, and sustainability, with total assembling capacity with batteries in the cabinet, and renders strong Total Cost of Ownership (TCO) credit for mission-critical data centers. About ZincFive ZincFive Awarded with 90 patents, ZincFive, a provider of nickel-zinc batteries and power solutions, utilizes the technology of The Power of Good Chemistry™ for the wellbeing of businesses, employees, and the environment. It is a private company based in Tualatin, Oregon, dedicated to the sustainability and safety of nickel-zinc chemistry, providing high power density, and optimizing performance for mission-critical applications, ensuring reliability, safety, and sustainability. It supports technology markets, the information technology sector, intelligent transportation, industrial engines, and data centers. Its products include the UPStealth® series, BC Series UPS Battery Cabinets, Monobloc Batteries, and Cylindrical Cells.

Read More