In response to growing pressure to boost the performance and trim down the size of embedded applications,standards
organizations meet regularly to optimize their portfolios in light of
the latest available technology. These updated standards take advantage
of new silicon architecture combining multiple processors, graphics
elements, and complex I/O to deliver the next generation of
preengineered, off-the-shelf modules to support many of the
high-performance requirements of embedded product development.
These
standardized computer platforms allow designers to trade in substantial
savings in Non-Recurring Engineering (NRE) and scheduling for slightly
higher recurring costs. Standards-based designs also shortcut the
software development effort by providing access to compatibleoperating systems, vendor-supplieddrivers, and sample firmware.
In
the Strategies section of this issue, we asked experts from several
standards organizations to bring us up to date on the latest changes
affectingembedded designs.
Starting things off, Jim Blazer, CTO at RTD Embedded Technologies and
active member of the PC/104 Consortium, presents the history and updates
in work – such as the latest generation of PCI Express – that support
the PC/104 stackable architecture. Citing the need for smaller and more
rugged building blocks, Alexander Lockinger, President of the Small Form
Factor Special Interest Group (SFF-SIG) and CTO at Ascend Electronics,
covers the trends and new products to expect in 2013. In addition,
Jerry Gipper, Director of Marketing atVITAandEditorial DirectorofVITA Technologiesmagazine,
reports on the recent Embedded Tech Trends 2013 meeting aboard the
Queen Mary and standards work in progress, plus some new technologies
such as optical interconnects.
We have expanded the Strategies section this month to bring you technical updates on a couple of developing trends in the intelligent systems marketplace. First, Andrew Patterson, Business Development Director for the Mentor GraphicsEmbedded SoftwareDivision, shows how open source opera-ting systems such asLinuxandAndroidare driving innovation in the in-vehicleinfotainment market. Next, Wil Florentino,Industrial AutomationMarketing Manager at Renesas Electronics, discusses the latest concepts available to integrate multipleanalogsensors into intelligent embedded devices. He explains how a configurable Analog Front End (AFE) simplifies the interface between these sensors and the digital world.
Regardless of the market segment, the software programming and certification phase has become the long pole in the embedded development tent. In this month’s Software section, we show how software design teams are adding advanced static code/analysis tools to the mix to shorten this extended development cycle and minimize post-release changes. Explaining the benefits and techniques used in static code analysis, Arthur Hicken, Wayne Ariola, and Adam Trujillo of Parasoftpresent several different analysis implementations and where they should be employed in the development process. Focusing on a single programming language, Jon Jarboe, Senior Technical Manager at Coverity, shows howstatic analysiscan be used to manage risk in aJava development environment. In addition, static analysis and contract-based programming can be combined to deliver softwarecomponentswith enhancedsafety and security, writes S. Tucker Taft, Vice President and Director of Language Research at AdaCore.
With requirements often changing over the course of a combined analog and digital development project, designers are turning to reconfigurable hardware to minimize schedule delays. In this issue’s Silicon section, Cypress Semiconductor Application Engineer Robert Murphy presents several examples showing how configurableSystem-on-Chip(SoC) peripherals can be combined to create multiple functional components. Speaking of reconfiguration, if you have ideas for future technical articles and coverage that would help in your design efforts, please let us know. Contributed articles are a great way to expose your technology or expertise to the embedded community, so if you have an idea, please send along an email with a short abstract.
802.11 networks are becoming nearly ubiquitous in many enterprise settings and can often be tapped to solve embedded
problems in the same location. In this example, a logistics cart used
for warehouse operations becomes 802.11 enabled, improving the
efficiency of a critical process.
In a tough economy with increased competition from global markets, companies are forced to do more with less. Supply chainmanagement
is one area where companies realize this challenge. Organizations are
continually struggling to ship more orders, decrease processing time,
and increase order accuracy, all the while reducing costs. The nature of
order processing has changed as well. With just-in-time and lean
manufacturing techniques becoming common practices, distribution
warehouses often need to process a high volume of small orders, which
often involve a large mix of products, adding further complexity to the
process.
IT managers are under increasing pressure to boost network capacity and performance to cope with the data deluge. Networking systems are under a similar form of stress with their performance degrading as new capabilities are added in software. The solution to both needs is next-generation System-on-Chip (SoC) communications processors that combine multiple cores with multiple hardware acceleration engines.
The data deluge, with its massive growth in both mobile and enterprise network traffic, is driving substantial changes in the architectures of base stations, routers, gateways, and other networking systems. To maintainhigh performanceas traffic volume and velocity continue to grow, next-generation communications processors combinemulticoreprocessors with specialized hardware acceleration engines inSoCICs.
The following discussion examines the role of the SoC in today’s network infrastructures, as well as how the SoC will evolve in coming years. Before doing so, it is instructive to consider some of the trends driving this need.
Networks under increasing stress
In mobile networks, per-user access bandwidth is increasing by more than an order of magnitude from 200-300 Mbps in 3G networks to 3-5 Gbps in 4G Long-Term Evolution (LTE) networks. Advanced LTE technology will double bandwidth again to 5-10 Gbps. Higher-speed access networks will need more and smaller cells to deliver these data rates reliably to a growing number of mobile devices.
In response to these and other trends, mobile base station features are changing significantly. Multipleradiosare being used incloudlike distributedantennasystems. Network topologies are flattening. Operators are offering advanced Quality of Service (QoS) and location-based services and moving to application-aware billing. The increased volume of traffic will begin to place considerable stress on both the access and backhaul portions of the network.
Traffic is similarly exploding withindata centernetworks. Organizations are pursuing limitless-scale computing workloads onvirtualmachines, which is breaking many of the traditional networking protocols and procedures. The network itself is also becoming virtual and shifting to a Network-as-a-Service (NaaS) paradigm, which is driving organizations to a more flexible Software-Defined Networking (SDN) architecture.
These trends will transform the data center into a private cloud with a service-oriented network. This private cloud will need to interact more seamlessly and securely with public cloud offerings in hybrid arrangements. The result will be the need for greater intelligence, scalability, and flexibility throughout the network.
Moore’s Law not keeping pace
Once upon a time, Moore’s Law – the doubling of processor performance every 18 months or so – was sufficient to keep pace with computing and networking requirements. Hardware and software advanced in lockstep in both computers and networking equipment. As software added more features with greater sophistication, advances in processors maintained satisfactory levels of performance. But then along came the data deluge.
In mobile networks, for example, traffic volume is growing by some 78 percent per year, owing mostly to the increase in video traffic. This is already causing considerable congestion, and the problem will only get worse when an estimated 50 billion mobile devices are in use by 2016 and the total volume of traffic grows by a factor of 50 in the coming decade.
In data centers, data volume and velocity are also growing exponentially. According to IDC, digital data creation is rising 60 percent per year. The research firm’s Digital Universe Study predicts that annual data creation will grow 44-fold between 2009 and 2020 to 35 zettabytes (35 trillion gigabytes). All of this data must be moved, stored, and analyzed, making Big Data a big problem for most organizations today.
With the data deluge demanding more from network infrastructures, vendors have applied a Band-Aid to the problem by adding new software-based features and functions in networking equipment. Software has now grown so complex that hardware has fallen behind. One way for hardware to catch up is to use processors with multiple cores. If one general-purpose processor is not enough, try two, four, 16, or more.
Another way to improve hardware performance is to combine something new – multiple cores – with something old – Reduced Instruction Set Computing (RISC) technology. With RISC, less is more based on the uniform register file load/store architecture and simple addressing modes. ARM, for example, has made some enhancements to the basic RISC architecture to achieve a better balance of high performance, small code size, low power consumption, and small silicon area, with the last two factors being important to increasing the core count.
Hardware acceleration necessary, but …
General-purpose processors, regardless of the number of cores, are simply too slow for functions that must operate deep inside everypacket, such as packet classification, cryptographicsecurity, and trafficmanagement, which is needed for intelligent QoS. Because these functions must often be performed in serial fashion, there is limited opportunity to process them simultaneously in multiple cores. For these reasons, such functions have long been performed in hardware, and it is increasingly common to have these hardware accelerators integrated with multicore processors in specialized SoC communications processors.
The number of function-specific acceleration engines available also continues to grow, and more engines (along with more cores) can now be placed on a single SoC. Examples of acceleration engines include packet classification,deep packet inspection,encryption/decryption,digital signal processing, transcoding, and traffic management. It is even possible now to integrate a system vendor’s unique intellectual property into a custom acceleration engine within an SoC. Taken together, these advances make it possible to replace multiple SoCs with a single SoC in many networking systems (see Figure 1).
Figure 1:SoC communications processors combine multiple general-purpose processor cores with multiple task-specific acceleration engines to deliver higher performance with a lowercomponentcount and lower power consumption.
In addition to delivering higher throughput, SoCs reduce the cost of equipment, resulting in a significant price/performance improvement. Furthermore, the ability to tightly couple multiple acceleration engines makes it easier to satisfy end-to-end QoS and service-level agreement requirements. The SoC also offers a distinct advantage when it comes to power consumption, which is an increasingly important consideration in network infrastructures, by providing the ability to replace multiple discretecomponentsin a single energy-efficient IC.
The powerful capabilities of today’s SoCs make it possible to offload packet processing entirely to system line cards such as a router or switch. In distributed architectures like the IP Multimedia System and SDN, the offload can similarly be distributed among multiple systems, including servers.
Although hardware acceleration is necessary, the way it is implemented in some SoCs today may no longer be sufficient in applications requiring deterministic performance. The problem is caused by the workflow within the SoC itself when packets must pass through several hardware accelerators, which is increasingly the case for systems tasked with inspecting, transforming, securing, and otherwise manipulating traffic.
If traffic must be handled by a general-purpose processor each time it passes through a different acceleration engine, latency can increase dramatically, and deterministic performance cannot be guaranteed under all circumstances. This problem will get worse as data rates increase in Ethernet networks from 1 Gbps to 10 Gbps, and in mobile networks from 300 Mbps in 3G networks to 5 Gbps in 4G networks.
Next-generation multicore SoCs
LSI addresses the data path problem in its Axxia SoCs with Virtual Pipeline technology. The Virtual Pipeline creates a message-passing control path that enables system designers to dynamically specify different packet-processing flows that require different combinations of multiple acceleration engines. Each traffic flow is then processed directly through any engine in any desired sequence without intervention from a general-purpose processor (see Figure 2). This design natively supports connecting different heterogeneous cores together, enabling more flexibility and better power optimization.
Figure 2:To maximize performance, next-generation SoC communications processors process packets directly and sequentially in multiple acceleration engines without intermediate intervention from the CPU cores.
In addition to faster, more efficient packet processing, next-generation SoCs also include more general-purpose processor cores (to 32, 64, and beyond), highly scalable and lower-latency interconnects, nonblocking switching, and a wider choice of standard interfaces (SerialRapidIO, PCI Express, USB, I2C, and SATA) and higher-speed Ethernet interfaces (1G, 2.5G, 10G, and40G+). To easily integrate these increasingly sophisticated capabilities into a system’s design, software development kits are enhanced with tools that simplify development, testing, debugging, and optimization tasks.
Next-generation SoC ICs accelerate time to market for new products while lowering both manufacturing costs and power consumption. With deterministic performance for data rates in excess of 40 Gbps, embedded hardware is once again poised to accommodate any additional capabilities required by the data deluge for another three to four years.