new-ui

In the previous article, I had briefly discussed the three features that would debut with the new user interface. Today, I would like to walk you through the entire job-setup process using the new UI. But before I do that, here’s a list of new features for you to skim over.

  • Job type visualization
    • Every job type on the platform is now visualized and its setup process is divided into multiple steps.
    • You can jump around different steps by clicking one of the icons in the visualized model, and review the summary of your job settings before submission.
  • Core-to-Instance mapping
    • The new hardware settings page provides a visual aid to help users identify the number of cores available for each instance.
  • Improved Transfer Experience
    • The new platform now supports transferring multiple files simultaneously, utilizing your bandwidth as much as possible.
  • Better License Selection Experience
    • You are given a simple set of options to choose from for software licenses, and you can choose the best option for each job.
  • Job sharing with a message
    • You can share your jobs with a customized message.
  • Improved overall experience
    • The entire platform behaves more like a desktop application, with every action followed by a quicker response.

Let’s set up a job by clicking on + New Job on the navigation bar.

newjob

In the previous UI, the requirements for setting up a simulation had not been laid out as clearly, but with the new UI, you’re given a set of specific steps that you must go through.

steps

As you can see, there are three parts for setting up a basic job – Input File(s), Software, and Hardware. There’s also Post Processing as the last step, but as it is indicated in the UI, it is optional. However, it is important to note that a user can navigate through different steps without entering valid information for each one. In other words, you can fill things out in any different order.

steps-viz

To move around, there are three different UI elements that you can use. First, you can use the Next and the Back buttons placed at the bottom of each page. Second, you can use the navigation elements on the right sidebar – clicking either the arrows or the names of the steps will take you to a different step. Lastly, you can navigate through different steps by clicking on one of the icons on job visualization.

transfer

To set up a job, it is recommended that you upload your input files first, even before you select your software. The dropdown menu for selecting an existing file(s) has not changed, but the progress of your transfer is now displayed on the navigation bar. As before, you can select either Basic or Enhanced for transfer methods.

software

In Software Settings page, you should select the software of your choice. In the new UI, you see more software in one page, thereby reducing the need for scrolling, and for each software we’ve included links to the tutorials that could help you set up your job. The command for the software must also be defined here.

hardware

In the new Hardware Settings page, you get a table of available core types so you can compare their specification more easily. Also on the right, you have the visualization for node to core type mapping and the availability of the Low Priority pricing option.

review

Finally on the review page, you get a summary of your setup, and you can decide whether to save or submit your job.

And that’s it! Here’s what the new “Status” page looks like for a submitted LAMMPS job that is executing.

status

First of all, notice that the sidebar menu has been collapsed to provide more space to the content. At the top of the status page is the list of steps that a submitted job has to go through, and there’s also a Gantt chart that shows how long each step takes.

tailing

Under the Gantt chart is the Live Tailing window, which behaves the same way except for its full-screen mode. In the new UI, the full-screen mode actually takes up the entire browser for easier file viewing. The rest of the UI elements should be familiar, as they were taken from the older user interface version.

results

When the job finishes running, the Results page is where you can see your all your output files. As before, you can view smaller files within the browser and download or remove specific files. Or if you’ve run a Design of Experiments (DOE) job, you can plot your data using the Charts page.

support

If you’re having trouble getting the right result or setting up your job, you can share your job with support. You can also add a message to explain your problems so that we may better understand your situation.

I hope this article serves as a good introduction to our new UI, and feel free to reach out to us if you have any comments or questions about our platform.

This article was written by Rescale.

collab

Whether by phone, live chat, or email, Rescale gets called upon daily to respond to critical computational problems from consulting engineers whose services are employed by customers in aerospace, automotive, energy, biological sciences, consumer products, and industrial engineering, among others. Calls come in from engineers and scientists around the globe who are in need of immediate consultation on how to solve their computationally-intensive simulation resource requirements.

Rescale’s engineers quickly and accurately help the consultant configure their compute and software resources to meet time-critical project deadlines. This is an important differentiator for the consultancy—a support capability that is a function of Rescale’s expertise across vertical use cases. What emerges as a result is the ability of a consultancy to carry a reliable cloud simulation solution in its customer-facing services portfolio.

Rescale offers the engineering consultancy practice a critical compute/IT orientation that is closely coupled with its software vendor affiliations. At Rescale, hundreds of CAE applications have been pre-tested and validated as customer-ready through our close working relationships with key software vendors and their customers. The ability to reconcile application and CPU requirements has long been a challenge that small to medium consultancies have previously not had in their tool kit.

Serving the OEM community in automotive, aerospace, and electronic design automation, the highly-skilled consultancy finds at Rescale a team that speaks its language. In fact, many of Rescale’s customers are themselves both developers and publishers of solvers and optimizers that imbed specific efficiencies within the larger ISV workflow. Having the ability to perform complex integrated solutions is a major resource for the consultant. Some consultancies historically have emerged from academia with code born in the computer software labs and then grown into successful companies—managed and staffed by Ph.D-level engineers who understand the problem sets of their focused solutions. Some of these companies are among the elite of CAE ISVs today having grown over the last 20+ years. Mating their expertise with Rescale’s core competencies is a powerful formula for customer success.

To be less generic, over the last four weeks we have worked with over 40 established or emerging developer/consultancies. There is really no established moniker for this category of engineering enterprise – they thrive in the U.S., Korea, Japan, Canada, Germany, The Netherlands, India, South Africa, Mexico, Brazil–the list goes on.  They all share one thing in common, their model sizes, unique customer simulation workloads, and opportunity exceeds dramatically their ability to scale quickly given their local access to compute resources. They and their clientele are among the “under-served”–meaning their needs include expanding the scale for critical modeling and simulation workloads with the clock ticking in hyper-time.  Rescale can instantly addresses demanding customer scalability requirements.

Rescale allows developer/consultancy practices the ability to go to market with a wide range of customizable, scalable, simulation resources—both for jobs being run internally for their own development, jobs run on behalf of customers, or for proposals they deliver to customers to win additional business. Rescale provides a tool set that brings greater elasticity and value to the consulting practice and spawns net new license adoption. If your company is oriented around these requirements–we look forward to speaking with you.

If you’d like to learn more about Rescale, please contact info@rescale.com.

This article was written by Rescale.

xflow-cloud-white

Benefit directly from the advantages of our pay-per-use cloud computing partnership
Rescale, Inc. and Next Limit Dynamics S.L. are pleased to announce a technology partnership that allows XFlow users the ability to run their MPI simulations on Rescale’s on demand cloud simulation platform. XFlow users now have access to tens of thousands of customizable HPC cores through Rescale’s platform to address even their most demanding simulations using a highly scalable, secure, web-based platform.

Background
CFD software XFlow was launched commercially by Next Limit Dynamics in 2011 and is now used by some of the biggest engineering and manufacturing companies globally.   This post recounts the story and motivation for the development of this “next generation” CFD solution, and how David M. Holman, XFlow General Manager, sees cloud technologies in HPC as one of the future CFD trends.

The Challenge of Traditional CFD
In the traditional mesh-based approach of CFD, the reliability highly depends on the quality of the mesh, and engineers spend most of the time working on the discretization. Plus there are severe difficulties in dealing with the changes in the topology of the domain for problems involving moving parts or fluid-structure interaction so traditional approaches have limited ability to model real problems.

Next Limit Dynamics’ motivation to develop a XFlow as a next generation CFD solution was to overcome these classic problems.

What is XFlow and what makes it unique?
XFlow is a best-in-class CFD technology that dramatically improves the ´solution quality vs. time-to-solution´ trade-off and significantly reduces implementation, training and support costs…How is it possible?

It features a novel particle-based kinetic algorithm that resolves the Boltzman equation. Being particle-based and fully Lagrangian means classic fluid domain meshing is not required, therefore, it is extremely easy to set up and use and allows enforced or 6-DOF constrained motion.

Furthermore, XFlow´s advanced techniques easily handle traditionally complex problems such as aero-acoustics, free surface, transient flows, moving parts and fluid-structure interaction. The solver’s high-fidelity approach to the turbulence is state-of-the-art LES (Large Eddy Simulation) modeling, combined with advanced non-equilibrium wall models with much more efficiency than other solvers.

HPC Support, a must for any CFD Software
Increasingly in many sectors, Next Limit Dynamics has found that many CFD users prefer using on-demand cloud-based HPC solutions over in-house hardware… Surprising?

Not really…transforming a capital expense to an operational expense is a strategic goal for many organizations. Instant availability and the ability to quickly scale up (and down) are some of the advantages. To be an HPC user with unlimited storage and instantly available, scalable high performance computing resources for the most demanding simulations, at any time, and all on demand, has been a challenge for many CFD users.

Moreover, it also allows basic IT infrastructure that, combined with a pay-per-use web-based model, makes CFD simulation affordable to a growing industry segment after many years of demand: startups, SMEs and niche companies.

Next Limit Dynamics’ David Holman, General Manager of XFlow Technology, acknowledges the need for MPI developments for HPC environments now more than ever—together with the growing need for these to be delivered directly through the cloud: As simulations are becoming more complex (and realistic) the user requirements are becoming more demanding on computational resources. We are working hard on making HPC environments affordable to smaller companies and occasional users by using pay-per-use models.”

Contact us for further information and benefit from the advantages of a cloud computing CFD solution with XFlow.

About Rescale:
Rescale provides a secure, pay-per-use, web-based platform that helps engineers and scientists build, compute, and analyze large simulations on demand. Headquartered in San Francisco, CA, Rescale’s customers include global Fortune 500 companies in the aerospace, automotive, life sciences, and energy sectors.

For more information about Rescale, please visit www.rescale.com.

About Next Limit:
With a mission of delivering state-of-the-art Computational Fluid Dynamics (CFD) solutions by using new paradigms that break the limitations of traditional methodologies, Next Limit Dynamics provides a next generation CFD software system, XFlow CFD, and simulation expertise to the largest engineering companies worldwide.

For more information about XFlow CFD, please visit http://www.xflowcfd.com.

This article was written by Next Limit.

remote-access
Introduction

Rescale has recently released additional user account job settings, which provide customers with the ability to securely connect to the remote clusters that they have provisioned in order to monitor or manage their running simulations more directly.

Users of HPC simulation tools can typically relate to the scenario wherein an analysis model is run for the first time, but the solver crashes for any number of reasons upon initializing the model’s computational domain and beginning the iterative solution. Another situation that users commonly encounter is one whereby a job has been submitted but is missing a requisite input file or an input parameter is set to an inappropriate value. Having the ability to login to the cluster directly enables users to more economically resolve these and similar issues when leveraging Rescale’s HPC platform.

Configuring your account settings on Rescale is straightforward and involves the following four steps:

Generating an SSH key pair
Adding the SSH public key to your Rescale account
Disabling the automatic termination of clusters option in your Rescale account’s job settings
Logging into a running cluster

Generating an SSH Key Pair

This section highlights for users of both *nix and Windows OS environments how to generate OpenSSH key pairs. If you’re familiar with SSH key generation, or have already generated a key pair previously that you use regularly, then you can skip ahead to the next section.

For users of *nix based operating systems, a command line utility exists named ssh-keygen that can be used to generate these public and private SSH keys from a shell prompt with the following:

Invoking this command will begin generating both public and private keys and prompt you for a location and filename on your local filesystem where you wish to store both keys. Alternatively, you can pass the ssh-keygen command the -f flag along with a path on your local filesystem where you want to store the keys (e.g. /home/rescale/Desktop/id- rsa) as its argument. Using this example, the private key file named id-rsa and the public key file named id- rsa.pub are both saved to subdirectory Desktop of user rescale’s home directory. If you omit the -f flag altogether, then you can opt to use the default which will place both id-rsa and id-rsa.pub files in a subdirectory of your home folder named .ssh (e.g. /home/rescale/.ssh).

You are also prompted to set a passphrase, and again to verify this passphrase, which is then used each time the public key is substantiated with the private key. By default, setting this passphrase is ignored, and doing so is typically preferred to avoid any hassle of entering this passphrase when logging into a remote host. Once the ssh-keygen command line utility has completed, then a 2048 bit RSA key pair should have been generated, and both private and public keys stored in their respective files at the location in your filesystem that was specified.

terminal_output

Figure 1: Generating SSH key pairs in a *nix OS

The options used to create the SSH keys—key type (RSA) and the number of bits created in the key (2048)—happen to correspond to the defaults used when invoking the ssh-keygen utility from a shell command prompt. As a result, equivalent keys could have been generated by just invoking ssh-keygen by itself at the shell prompt. These options have been highlighted here to inform end-users of options they may wish to leverage when generating their own keys. For example, those conscientious about security may wish to generate a 4096 bit key instead of the 2048 bit key used in this example. Note that if users opt for generating DSA keys rather than RSA keys, then they are limited to using exactly 1024 bit keys as specified by FIPS 186-2.

On Windows systems, there are a number of options available for generating an OpenSSH key pair. One popular tool that users typically have available on their systems is PuTTY. If not already installed, it is easy to download and straightforward to install. Once installed, start the puttygen.exe executable. In the section of The PuTTYGen window labeled “Parameters”, click the radio button next to SSH-2 RSA and enter the value 2048 in the field next to “Number of bits in a generated key:” as illustrated in Fig. 2.

Once both parameters have been set as described, then click the button labeled “Generate” in the “Actions” section of the window to begin producing the SSH key pair.  Users are next prompted to move their mouse cursor inside of the designated “blank” area within the PuTTYGen window to introduce some randomness into the key generation process. Continue moving the mouse in the designated area of the window until the blue progress bar indicates that key generation has completed. Finally, save both public and private keys to separate files on the local filesystem using the corresponding buttons located in the “Actions” section of the PuTTYGen window.

Once both keys have been saved in their respective files, then users should ensure they safeguard the the private key and note its location on their local filesystem

putty1

Figure 2a: Generating OpenSSH key pair in Windows using PuTTY

putty2

Figure 2b: Saving public and private OpenSSH keys in Windows using PuTTY

Adding the SSH Public Key to your Rescale Account

Once an OpenSSH public and private key pair have been generated, users can log in to their Rescale accounts and navigate to the ”Job Settings” page via their user account menu as highlighted in Fig. 3.

account-menu

Figure 3a: Access the job settings page from your Rescale account menu

job-settings

Figure 3b: Copy your public SSH key into the field labeled “SSH Public Key”

Users can open the file that they saved the SSH public key in their preferred text editor, copy its contents, and paste the text into the field labeled “SSH Public Key” on the “Job” settings page. Users may optionally further restrict access to the cluster hosting their simulation by specifying a Classless Inter-Domain Routing (CIDR) rule to limit access to the cluster to either a single IP address or a range of IP addresses depending on a user’s preference. Rules can be easily generated to allow access from “Everywhere”, or “My Current IP Address” using the pull-down menu options available. Users can also create a custom rule by editing the “Access Restriction (CIDR)” field directly.

Disabling Automatic Termination of Clusters

Clusters that host a user’s running simulation are provisioned and configured on-demand. Once the simulation has completed running, the user’s runtime files are moved off of the cluster, and the cluster resources are shut down. If you’re troubleshooting issues with your simulation, you may want to avoid this automatic shut down behavior, so that you can login to the cluster directly, review and correct any issues that arise, and restart the simulation. In order to prevent the cluster from shutting down automatically, uncheck the box next to the option labeled “Terminate Clusters Automatically” at the very bottom of the “Job” settings page.

Note, that users disabling this option are responsible for terminating their clusters manually, and Rescale is not responsible for charges that accrue as a result of user forgetfulness which leaves the cluster running beyond the intended duration. Users should be mindful of the potential repercussions that may result when disabling this option.

Logging Into a Running Cluster on Rescale

Once your public SSH key has been added to your Rescale account’s job settings and you submit a new job, Rescale’s platform uploads the public SSH key associated with your account to the cluster that you provision. The job status message window will display the username and IP address of the head node for this cluster as depicted in Fig. 4.

job-logs

Figure 4: “Job Log” window on Rescale’s “Status” page

Using these credentials, users can login into the remote cluster directly. In *nix OS environments users can run the following command at a shell prompt:

Here would be replaced with the corresponding UNIX filesystem path (e.g. /home/rescale/Desktop/id-rsa). If the SSH private key is located at $HOME/.ssh, then ssh will automatically look for private keys stored at that location and the -i flag with its path argument aren’t required. If users are interested in forwarding their remote X-Window display to their local display, then they can invoke the X11 forwarding feature built-in to ssh by passing the -Y flag to the above ssh command. This enables some basic interaction with GUI applications running on the remote cluster for customers if needed.

PuTTY is again utilized to demonstrate establishing the remote SSH connection for users in Windows OS environments. After launching putty.exe, users can specify the location of the private SSH key file stored on their local filesystem by navigating to the Connection -> SSH -> Auth pane and clicking on the “Browse…” button. Next return to the “Session” pane, ensure that the radio button next to SSH in the “Connection type” section is selected, enter the username and IP address provided via Rescale’s job status log message window into PuTTY’s field labeled “Host Name (or IP address)” (e.g. zach_Gcaaa@54.91.153.220), and finally click on the button labeled “Open”. A remote connection session window should open and login to the remote cluster using the credentials provided.

Once your simulation has completed running, be sure to transfer any runtime files back to your local environment, and be sure to click the “Terminate” button on the “Status” page for that particular job to avoid incurring any additional charges.

This article was written by Rescale.