Skip to main content

Designing new methods for DAG scheduling problem for cloud computing


Objective:- Designing new methods for DAG scheduling problem for cloud computing.

Abstract:-

It is a scheduling layer in a spark which implements stage-oriented scheduling. It converts logical execution plan to a physical execution plan. When an action is called, spark directly strikes to DAG scheduler. It executes the tasks those are submitted to the scheduler.

The objective of DAG scheduling is to minimize the overall program finish-time by proper allocation of the tasks to the processors and arrangement of execution sequencing of the tasks. Scheduling is done in such a manner that the precedence constraints among the program tasks are preserved. The overall finish-time of a parallel program is commonly called the schedule length or make span. Some variations to this goal have been suggested. For example, some researchers proposed algorithms to minimize the mean flow-time or mean finish-time, which is the average of the finish-times of all the program tasks [25], [110]. The significance of the mean finish-time criterion is that minimizing it in the final schedule leads to the reduction of the mean number of unfinished tasks at each point in the schedule. Some other algorithms try to reduce the setup costs of the parallel processors [159]. We focus on algorithms that minimize the schedule length.

INTRODUCTION:-

The Cloud is a huge, interconnected system of Powerful servers that provides businesses and individuals with services [1] The concept (Cloud Computing) refers to the ability for online users to share resources offered by the service provider. Without needing to buy expensive hardware, to leverage the high-service provider's capabilities[2]. The main goal of the cloud computing model is to allow users to share resources and data, Software as a service (SaaS), application as a service (PaaS), and infrastructure as a service (IaaS). As the number of cloud users has grown in recent years, the number of tasks that must be managed propositionally has increased, necessitating task scheduling[3]. methodology is based on Reinforcement learning

RELATED WORK:-

The task scheduling algorithm's main goal is to ensure that tasks are completed as efficiently as possible. List scheduling algorithms are used in the task scheduling process. In list scheduling algorithms, there are two distinct phases. The first phase entails determining the tasks' priority, and the second phase entails assigning tasks to the processor in the order determined[3], They will be discussed as follow. In 2017 (Wei et al.)[4] t has been proposed a task scheduling algorithm based on Q-learning and the mutual value function (QS).


Workflow model:-

A directed acyclic graph, G=(V,E), represents an application, with V representing the set of v tasks and E representing the set of e edges between the tasks. Each edge (imp) E represents a precedence constraint, requiring task to finish before task can begin.

Data is a v×v matrix of communication data, with indicating the amount of data to be transmitted from task to task . DAG scheduling object: node tasks are assigned object resources that must satisfy a chronological order constraint in order to reduce the total time to completion.


Components of proposed algorithm:-

RL, MDP, and the Q-learning algorithm


Proposed Scheduling Algorithm:- Input: DAG all Tasks.

Output: The make span.

Procedure:

1: Create DAG for all tasks.

2: Set gamma parameter, environment rewards in matrix R. 3: Initialize matrix Q to zero.

4: Repeat for each episode. 5: Select an initial state.

6: While the goal state not reached Do.

7: Select possible actions for the current state. 8: Go to the next state.

9: Get maximum Q value with E.g. (6). 10: Set next state as a current state. 11:Update Q(state, action) with E.g. (6).

12: Obtain tasks order according to updated Q-table.

13: Map task to the processor which have the minimum execution time. 14: Calculate the make span.

15: Until no longer changes in make span





Conclusion:-

Existing scheduling algorithms focused on the time. The main goal of these schedulers is to reduce the overall Make span of the workflow. Gaps in current workflow scheduling strategies in the cloud environments were studied in this thesis, and an effective scheduling method for workflow management in the cloud setting was proposed based on the gap analysis. It has b even determined that the current scheme is effective enough to make the best use of the available resources. There are two stages to the algorithm design theor








Comments

Popular posts from this blog

Create a socket for HTTP for web page upload and download

Create a socket for HTTP for web page upload and download. Aim: To write a java program for socket for HTTP for web page upload and download . Algorithm 1.Start the program. 2.Get the frame size from the user 3.To create the frame based on the user request. 4.To send frames to server from the client side. 5.If your frames reach the server it will send ACK signal to client otherwise it will send NACK signal to client. 6.Stop the program Program : Client import javax.swing.*; import java.net.*; import java.awt.image.*; import javax.imageio.*; import java.io.*; import java.awt.image.BufferedImage; import java.io.ByteArrayOutputStream; import java.io.File; import java.io.IOException; import javax.imageio.ImageIO; public class Client{ public static void main(String args[]) throws Exception{ Socket soc; BufferedImage img = null; soc=new Socket("localhost",4000); System.out.println("Client is running. ");  try { System.out.println("Reading image from disk. "); im...

Write an HTML program to design an entry form of student details and send it to store at database server like SQL, Oracle or MS Access

Write an HTML program to design an entry form of student details and send it to store at database server like SQL, Oracle or MS Access <!DOCTYPE html> <html> <head> <title>PHP insertion</title> <link href="css/insert.css" rel="stylesheet"> </head> <body> <div class="maindiv"> <!--HTML Form --> <div class="form_div"> <div class="title"> <h2>Insert Data In Database Using PHP.</h2> </div> <form action="insert.php" method="post"> <!-- Method can be set as POST for hiding values in URL--> <h2>Form</h2> <label>Name:</label> <input class="input" name="name" type="text" value=""> <label>Email:</label> <input class="input" name="email" type="text" value=""> <label>Contact:</label> <inp...

Write a code simulating PING and TRACEROUTE commands

  Write a code simulating PING command     Aim:   To Write the java program for simulating ping command   Algorithm Step 1: start the program. Step 2: Include necessary package in java. Step 3: To create a process object p to implement the ping command. Step 4: declare one BufferedReader stream class object. Step 5: Get thedetails of the server          5.1: length of the IP address.          5.2: time required to get the details.          5.3: send packets , receive packets and lost packets.          5.4: minimum ,maximum and average times. Step 6: print the results. Step 7:Stop the program.   Program:   import java.io.*; import java.net.*; class pingserver { public static void main(String args[]) { try { String str; System.out.print(" Enter...