Tag Archives: Sub-project Sentence

How to Deal with Rejection 1: What could I have done better?

Are you driven by the question or by the project?

Did you design a project that will answer your question? Thanks to Nick Kim, http://lab-initio.com

Getting a grant application rejected has three things in common with other rejections.

  1. Rejection is slightly less painful if you have other applications still being considered.
  2. Regardless of how painful it is, rejection is an important learning opportunity.
  3. Regardless of the pain and the learning, you need to make sensible decisions about whether, and how, to try again.

I know – believe me I really know – that getting grant applications rejected is painful. In my experience the combination of pain and humiliation can make it impossible to think analytically about the application for weeks or months. However, unless your desire to do research is completely extinguished, sooner or later you have to come back. When you do, it’s really important to learn as much as you can from the rejection and use it to plan the best way ahead.

If you are still consumed with the pain of rejection, you might want to bookmark this page and come back when you feel able to be analytical. However there are three practical  reasons you might want to work through the pain and deal analytically with the rejection now.

  • Dealing constructively with a rejection helps to draw a line under it and resolve the pain.
  • The sooner you start, the better will be the outcome for two reasons.
    • You will do a better job on the analysis if you do it while your memory is fresh.
    • Any plans you develop as a result of the analysis are more likely to be successful if you can implement them before they go out of date.
  • The more times you deal with rejection, the easier and the quicker it gets. I can remember once  (admittedly it was about my 20th rejection) I was able to deal with it in less than a day, rewrite the grant in under 3 weeks and get it fully funded.

If you have got this far I am assuming you want to be analytical. There are four separate steps.

  1. Work out why your grant application was rejected.
  2. Work out how you could have made it stronger.
  3. Salvage useful components.
  4. Get back on the horse.

I’ll deal with the first two in this post and the other two next week.

Work out why it was rejected

Usually the reviews you get back will  say lots of good things and it can be hard to understand why an application with so much going for it could have been rejected. Rejections usually boil down to:-

  • the committee thought the research question wasn’t important enough or
  • the committee couldn’t see how the project would answer the question.

There are three things you should consider here.

  1. It only takes one hole to sink an otherwise perfect boat. It might make it easier to find the hole if you filter out the negative comments and look at them separately.
  2. In most cases the committee discussion is more important than the referees reports but the description of their discussion is likely to be both short and vague. So the hole in the boat my not be very well defined.
  3. Funding rates are falling and sometimes perfect grants, grants that propose well-designed projects that will answer important questions, don’t get funded because there just isn’t enough money.

Don’t be too eager to assume that your grant was perfect. If the funding rate was 30% or better then it’s very unlikely. In fact, most grants that get funded could be improved significantly.

Work out how you could have made it stronger

Regardless of why your grant application was rejected, you should look to see whether it could have been improved. This is particularly important if the reason for rejection is not apparent from the comments: a badly written grant simply fails to convince the reader – the reader may not know why.

You should look separately at four elements:- the description of the project, the background, the introduction, and the summary. As a rough guide you should be clear on the following questions:-

Description of the project

  • Is it clear what you will do?
  • Have you explained the steps that will take you from starting research to having a set of findings that are written up and disseminated?
  • Is the project divided into three or four (i.e. more than two and fewer than five) phases?
  • Is it clear what will be discovered by each phase of the project?

Background to the Project

  • Have you given a good reason why you should do your project? Have you linked it to an important question?
  • Is your link direct (your project will completely anser the question) or indirect (your project will take some important steps towards an answer to the question)?
  • Has the funder stated explicitly or implicitly that this question is important? This is probably worth a whole post. I’ll get around to it.
  • Have you linked the question clearly to each phase of your project by showing that we need to know what each phase of the project will discover?
  • Do other authors agree with your specific ‘we need to know’ statements or are they individual to you?
  • Have you cited publications that demonstrate that your team are competent to produce new discoveries in this area?
  • Have you overstated your contribution to the field?
  • Could other people think this area is a backwater rather than a niche?

 Introduction

  • Does the introduction make all the statements listed in the ‘key sentences‘?
  • Does the introduction state every thing that  ‘we need to know’.
  • Does the introduction state  every thing that the project will discover?
  • Are these statements in the introduction clearly the same as the statements that begin the corresponding sub-sections of the background and the description of the project? They should be recognisably the same statements although they don’t have to be exact copies.

Summary (I mean the summary of the Grant Application)

The summaries of most successful grant applications are appallingly bad. You can see this if you look for the details of successful proposals from the UK research councils or from the European Research Council. However, a good summary helps the funding agency to choose more appropriate referees and it helps the referees and the committee members to understand the research. You should check the following:-

  • Does the summary make all the statements listed in the ‘key sentences‘?
  • Does the summary state every thing that  ‘we need to know’.
  • Does the summary state  every thing that the project will discover?
  • Are these statements in the summary clearly the same as those in the introduction? They should be recognisably stating the same thing although they don’t have to be exact copies.

What Next?

It’s very likely that these two exercises will give you a clearer sense of how you could have given your application a better chance. Next week I will discuss what raw material you can take from a rejected grant application and how to turn it into the basis of future success.

Key Sentence Skeletons

Is there a recipe for the 10 key sentences?

RECIPE

Recipe for Key Sentences in a Grant Application?

This post is about an easy way to work out what to write the 10 key sentences that define a grant application. There are two reasons I think it’s worth writing even though I have written about the key sentences several times recently.

  • A good set of key sentences is half-way to a case for support. A really good case for support consists of nothing more than the 10 key sentences and the text that fills in the detail and convinces the reader that the key sentences are true. Of course this extra text is much more than filler, but it is a great help to have the key sentences because they define the task of the rest of the the text.
  • I have been working with a couple of clients who, even though they are clever people and they get the idea of key sentences, find it really hard to write them. So I have been on the lookout for a good way of making it easy to write a good set of key sentences.

Skeleton sentences, which Pat Thomson’s excellent blog recommends as a way of handling difficult but often repeated writing tasks such as framing a thesis introduction, or introducing a theoretical framework, look perfect. You take a key sentence that works; you separate it into its component parts and identify the parts that are specific to its current use and the parts that are generic. Then you turn the generic parts into a skeleton and replace the parts that are specific to its current use with equivalent parts that are specific for your use, and you have your own equivalent sentence.

Complication warning

ComplicationWarningI should perhaps warn you at this stage that although this post really does simplify the process of writing key sentences, it is quite detailed and it doesn’t do anything else. So if you aren’t trying to write a grant application   you should probably just bookmark the page and return when you start writing your next grant.

Finally, before I get down to the nitty gritty, I have two strong recommendations.

  1. It is very risky to start writing key sentences before you have worked out the details of your research project. As soon as you have done that you should divide it into three or four sub-projects, each of which will find something out, establish something, or develop something. This post tells you how to do that.
  2. Although it makes most sense to read about  the key sentences in numerical order, it’s pretty hard to write them in that order. I’ll make some suggestions about writing order as I explain the recipes.

So, what would skeletons for the 10 key sentences in a grant application look like? I think I can tell you in 9 of the 10 cases. I will describe them in numerical order, which is the order in which the reader will encounter them.

Key sentence 1, the Summary sentence

The first sentence of the proposal, key sentence 1, is probably the most complex and variable of the key sentences. It gives a simple overall statement of what the project will achieve, ideally it will relate that achievement to a big important problem and will also include something distinctive about how the project will achieve it in a way that will make it clear that you are a suitable person to do the project.

A minor variation of a sentence I suggested in an earlier post about key sentences, does all this. It has four parts, which are numbered.

  1. This project will develop a new potential treatment for stroke
  2. by identifying, synthesising and testing suitable molecules
  3. from a family of novel synthetic metabolic inhibitors
  4. that we have discovered.

A skeleton representation of the four parts would be:

  1. This project will [your own description of  how it will make partial progress towards solving a  huge, important problem – in the example it’s “develop a potential solution”]
  2. by [ your own much more specific description of what it will actually do]
  3. [your own assertion that the project is novel or timely – e.g.”novel synthetic metabolic inhibitors”]
  4. [your own claim to “ownership” of the project – e.g.”that we have discovered”].

I would suggest that you leave the first key sentence until near the end. I would also suggest that you content yourself with a rough draft initially. You will have plenty of time to refine it as you flesh out the detail int he case for support.

Key sentence 2, the Importance sentence

The second key sentence states the importance of the specific outcomes promised by the project. The following sentence does this in two ways. The first clause gives some evidence that the big problem is really important. The second clause asserts that the specific problem that will be solved by the project is an important aspect of the big problem.

  1. Stroke is one of the commonest causes of death and disability in the working population;
  2. one of the most promising new avenues of treatment is to shut down brain function reversibly using a metabolic inhibitor, we have yet to identify a suitable molecule.”

Its skeleton is

  1. The [huge important problem] is [your own statement that demonstrates with evidence that the problem is very important for one or more of health, society, the economy and the advance of knowledge and understanding];
  2. [your own statement that the project outcome will contribute to solving the huge important problem].

I think that the second key sentence is definitely the last one to write.

Key Sentences 3-5, the Aims sentences

Sentences 3-5 would be the first and the easiest sentences for you to draft. They are what I used to call the “we need to know” sentences. There is one for each sub-project. An example from our hypothetical stroke project would be:- We need to identify which molecules in this family are most effective as reversible inactivators of brain tissue. The skeleton for an aims sentence would be something like this.

We need to [know or establish or develop]+[your own statement of whatever the sub-project is going to discover or establish or develop].

Each of the aims sentences introduces a section of the background to the project (the bit where you justify the need for your research) in which you convince the reader, by citing relevant evidence, that the key sentence is absolutely, starkly and compellingly true. You would also re-use the same sentence in the introduction to the case for support and in the summary.

Specific Aims

Some funders – notably NIH and the UK research councils, like you to talk about aims, or even specific aims. For this you create a compound of all 3  aims sentences of the following form.

We have three (specific) aims:-
1) to [discover, develop or establish] [your statement of whatever the first sub-project is going to discover, develop or establish]
2) to  [discover, develop or establish] [your statement of whatever the second sub-project is going to discover, develop or establish]
3) to  [discover, develop or establish] [your statement of whatever the third sub-project is going to discover, develop or establish]

Key Sentence 6, the Project Overview sentence

This sentence introduces the description of the research project by saying what kind of research it will involve, something about the facilities it will use – especially if these are distinctive in some way, and what it will discover. It may say something about the resources it will use. It is very similar to sentence 1 but it might have a bit more information about the kind of research and the specific outcome.

The following sentence, in italics, is an example related to our example of sentence 1. The proposed project will be a mixture of synthetic chemistry to produce candidate molecules and in vitro physiology to test their efficacy in producing reversible inactivation of brain slices in order to identify a potential treatment for stroke. The skeleton sentence, is The proposed project will [general description of research activity] to [specific description of research outcome] in order to [weak statement indicating partial progress towards solution of huge important problem].

I think that the project overview sentence should be written after the sub-project overview sentences.

Key Sentences 7-9: Sub-project Overview sentences

Each sub-project has a “this will tell us” sentence that matches the “we need to know” sentence but is a little bit more complex. It begins with a clause that summarises what you will do in the sub-project and continues with a main clause that says what it will tell us. For example:- We will use voltage sensitive dyes to assess the activity and responsiveness of brain slices in order to measure the effectiveness of different molecules as reversible inactivators of neural activity.

The skeleton would be:- We will [do the relevant research activity] in order to discover [the thing that we said we needed to know in the corresponding Aims sentence].

If your funder asks you to list research objectives as part of the grant application, or if it suits your writing style you can phrase (or rephrase) your “this will tell us” sentences as statements of objectives. They would read like this.

The research objectives are as follows:-
1) to [do the relevant research activity] in order to discover [the thing that we said we needed to know in the corresponding Aims sentence].
2) to [do the relevant research activity] in order to discover [the thing that we said we needed to know in the corresponding Aims sentence].
3) to [do the relevant research activity] in order to discover [the thing that we said we needed to know in the corresponding Aims sentence].

Key sentences 7-9 can be written as soon as you like. You should have everything you need to write them right at the start. However, they are a bit more tricky than key sentences 3-5, which is why I recommend that you start with those.

Key sentence 10, the Dissemination sentence.

The dissemination sentence should introduce a description of the projects dissemination phase. It may say something about what you will do with the results to create a platform for future research – by you or by others. The range of possible dissemination strategies is too great for me to construct a skeleton, however I will comment on the relative importance of dissemination versus building a platform for future research. The relative importance depends somewhat on key sentence 2.

Dissemination beyond the research community is important if key sentence 2 claims that the importance of your project is related to some practical problem or opportunity (curing a disease, making a technological breakthrough). Your dissemination plan will need to include steps you will take to make sure that the results are put to use and your project. You may also be requesting funds for dissemination activities.

On the other hand, if the importance of your project is purely to do with its potential to advance your subject, you probably do not need to say much about dissemination activities although it might be important to talk about communicating the results to your research community by publication and conference activity.

 

 

Put some meat in your feedback sandwich

7213133_s

Make sure that your feedback sandwich has plenty of meat.

This is one of a series of posts with advice for people who review grant applications for their friends and colleagues. It is also intended to encourage people writing grant applications to review what you have written before you ask a colleague to read it and tell you something you could have worked out for yourself. My last post argued that a quick and easy way of reviewing a grant application is to check its structure. Good structure makes a grant application easy to read.

Most applications will have very poor structure. If the structure is poor, it is not worth reviewing the detailed content. One reason is that it will take too long. Another is that, even if the content is very good, a funding committee’s enthusiasm for the application will be limited because the poor structure makes it difficult to understand.

At this point I feel honour-bound to confess that I have hesitated a couple of weeks before finishing this post because I know that many people find my feedback a bit too direct. They like to soften criticism by constructing a feedback sandwich that smothers useful comments in copious quantities of praise. My view is that feedback should be clear, it should explain how the proposal can be improved, and it should be delivered as quickly as possible. Feel free to cut and paste from what follows and to wrap it up in whatever form suits you.

The application should have an introduction that states clearly:-

  • what goal the project will achieve;
  • why the goal is important;
  • about three aims, which are things that we need to discover or understand in order to achieve the goal;
  • the general research approach;
  • about three research objectives, which are pieces of research that will enable us to achieve the aims; and
  • what will be done with the results.

These statements are what I call the ‘Key Sentences’. They are a distillation of the argument that the project deserves funding. If the grants committee believe the key sentences, they will almost certainly award a grant. So the rest of the case for support should be designed to make the reader believe the key sentences. It does this by repeating them, and reinforcing them with evidence or explanation.

After the introduction, the case for support has two main sections, each of which repeats six of the key sentences and then justifies or explains them. The background section deals with the goal, the importance and the aims. It should explain, with evidence, why the goal is important and how meeting the aims will achieve the goal. The description of the research project deals with all the rest. It should explain in detail the research approach, the research objectives, and what will be done with the results.

The structure allows a reader to understand the message of the grant in 2 or 3 minutes, by ‘speed-reading’ it. This is very important. The committee that decides whether or not to award the grant will have dozens of other applications to read and discuss. Most members will have a limited understanding of the detailed argument. Some of them will still be reading the application during the final discussion about whether to fund it. All of them will have a say in whether it gets funded. They will be much more enthusiastic to fund an application that they can understand and remember.

The structure also helps the referees who will read the proposal thoroughly and write an evaluation. Each key sentence leads directly to the detailed argument and evidence that justifies and explains it. It is not quite as important to make referees’ task easy because each referee typically only deals with a small number of proposals. Moreover, their enthusiasm will be based on their evaluation of the detailed argument. But it definitely doesn’t hurt to make their task easy.

Opening sentence

The opening sentence must whet the reader’s appetite. The best way to do that is to say what the project will achieve, together with something about how it will achieve it, ideally with a clear implication that the research team are well qualified to do the work. For example, the sentence “This project will develop a new potential treatment for stroke based on a family of synthetic metabolic inhibitors that we have discovered, and synthesised” achieves all this. The reference to discovery and synthesis suggests that the project is a continuation of past work. Of course the suggestion that the project continues previous work does not testify to its importance – that will rest on the opening clause, which states that the project will develop a new potential treatment for stroke.

Draft grant applications quite often have a good opening sentence. But it is not usually at the beginning. Usually it is somewhere towards the middle. Skim through the whole case for support to see if there is a suitable opening sentence that can be moved to the opening position.

It is useful to repeat the opening sentence at the start of the background section, which usually follows after the introduction. It is also useful to open the summary with the same sentence. Repetition of this kind is very good: it helps the reader to remember the essential message. Unfortunately most academics don’t like to repeat a message unless they can confuse readers by using completely different words.

Importance sentence

It’s useful to have a sentence explaining that what the project will achieve is important and to have it follow the opening sentence, which says what the project will achieve. Health, social, or economic benefits are usually, depending on the remit of the funder, good reasons that something is important. Solving a major theoretical problem may also be a good reason. Being the next logical step from the applicant’s previous research is typically not a reason for importance, although mentioning this kind of progression can be a useful way of supporting the proposition that the applicant has the necessary skills to carry out the research.

The importance sentence should also be repeated in the background section and in the summary.

Aims

The aims of the project should be stated immediately after the importance sentence. If you don’t know the difference between aims and objectives (surprisingly, the Oxford Dictionary is rather little help: its definition of ‘objective’  is ‘thing aimed at’), read this excellent post on Pat Thomson’s blog.

I suggest that there should be about four aims. I also think that because funding agencies often ask you to state aims and objectives, you should use them as key parts of the structure. A good way to state an aim is to say that “We need to know” something. There are three important things to check about each stated aim.

The aim should be restated, word for word, in the background section, where it should be followed by a few paragraphs that convince the reader that this is an important aim. Usually they do this by citing appropriate literature. Stating and justifying the aims like this is a device to create a direct link between what the project will do, and an important underlying question that the funder will pay to have answered. It’s also a way of papering over the cracks when the link is a bit tenuous.

The aims of the project should also be stated in the summary. Repeating them exactly, using the same sentences, is a good way of helping the reader to remember them.

Project overview sentence

It is useful to have a sentence that says what kind of research project is envisaged and what the likely outcome will be. It’s often necessary to have something that puts the reader in the right frame of mind for the subproject overview sentences. This sentence should be in the introduction and should be repeated at the start of the section of the proposal that describes the research project in detail.

Sub-project overview sentences (Objectives)

The essential difference between aims and objectives is that, aims tend to be abstract and objectives tend to be concrete. Aims are things that we would like to achieve. Objectives are the concrete things that we will do in order to achieve those aims. Thus the four or so sub-projects that comprise a research project are objectives. Matching the objectives to the aims is a good way of convincing the reader that the research needs to be done: the description of each sub-project should begin with a sentence that includes the phrase “this will tell us” whatever the corresponding aim says “we need to know”.

These sentences should be ‘pre used’ in the introduction and in the summary.

Dissemination

The last substantive sentence in the introduction should say something about what will be done with the results. Again, this sentence should be re-used to introduce the last sub-section of the description of the research project, which should explain it in detail.

So, that’s the filling for the feedback sandwich. How do you wrap it up? I think that it’s up to you to use your judgement. All the wrapping does is to set a baseline. In my view it doesn’t much matter where the baseline is, as long as it is absolutely clear how much the structure of the case for support could be improved.

I should point out that some funders, including several UK Research Councils, require applications to contain a section detailing the achievements of the research team.  That section, which is an excellent way of supporting the competence proposition, is in addition to those discussed in this post.

Review a Research Grant Application in Five Minutes

PeerReviewCartoon

Cartoon by Nick D Kim, http://strange-matter.net

This post tells you how to do a five-minute review of a research grant application. If you are asked to comment on a grant application by a friend or colleague, you should begin with this five minute review. In 95% of cases it will be all you need to do. Except create the feedback sandwich of course.

If you are writing a grant application, before you ask anybody else to read it you should spend five minutes reviewing it yourself. Far too many of the grant applications that I get asked to read take me a lot less than five minutes to review. Then it takes several days to construct a palatable feedback sandwich with the filling  “rewrite this completely”.

I don’t say you can review the detailed content of a grant application in five minutes. That takes longer and I will write about how to do it quickly in a future post. However, five minutes is plenty of time to review the framework of the case for support and check that it is appropriately used.

The framework is important for two reasons. First, if it is good, it tells the reader the essential story of your grant application very quickly. Remember, most readers only want to know the essential story. Second, the framework guides the reader to the detailed content that supports and justifies the essential story, so that the detail can be reviewed effectively and quickly.

‘Summary Sentence’

The most important part of the framework is a summary sentence. This should say what the project will achieve and enough about how it will achieve it to give a bit of distinctiveness and a bit of plausibility. It is essentially the elevator pitch, except that instead of taking 30 seconds to 2 minutes to say it or read it, it should take more like 15 seconds. The summary sentence should be the first sentence of the introduction, so it should take no time to find it, you still have 4 minutes 45 seconds left.

If you read my last post you will recognise that the summary sentence is what I refer to there as the first key sentence. So it will come as no surprise that you should check that the summary sentence is re-used as the first sentence of the part of the case for support that sets out the background to the research project. Let’s allow 15 seconds to do that. 4 minutes 30 seconds left.

‘Importance Sentence’

Now you should spend 20 seconds checking the second sentence of the introduction. It’s the importance sentence. It should say something about why it is important to achieve whatever the project will achieve. Make a mental note about whether the importance sentence has a practical element. Does it mention a real world problem – childhood cancer, the economy, forgetfulness in old-age, or some such. It’s not essential that there is a practical element to the importance sentence but it has implications for the dissemination sentence, which you will review in a few minutes time.

As soon as you have checked the importance sentence for practical content, jump to the background section and check that the importance sentence is repeated there. This is just a quick glance, so it should only take you 10 seconds. You have 4 minutes left.

‘Aims Sentences’

Go back to the introduction. Immediately after the importance sentence there should be a set of aims sentences, about four sentences setting out the aims of the project. The aims sentences should state things that we need to know, understand, characterise or in some way discover. The aims sentences could be preceded by a linking or framing sentence and they could easily be formatted as bullet points. Checking that the aims sentences are in the right place should take you 10 seconds. Do not look at the content of the aims sentences yet. Wait 30 seconds until we get to the sub-project overview sentences.

Now you should check the next sentence of the introduction. It should be the ‘project overview sentence’.

Project overview Sentence.

The project overview sentence gives a simple one-sentence overview of the project. It might also be structured as a linking sentence to the four or so sub-project overview sentences, which should immediately follow it and which could appear as bullet points and could be expressed as objectives. It should take you 30 seconds to read the project overview sentence and 20 more to check that it appears again to introduce the part of the case for support that gives the detailed description of the research methods and of the project.

Next you can spend 10 seconds checking that the sub-project overview sentences follow the project overview sentence. Now you are ready to check their content against the content of the corresponding aims sentences.

Sub-project overview sentences; content of aims sentences

Each aims sentence should link logically to the corresponding sub-project overview sentence in the following way. The aims sentence should say “We need to know X”. The sub-project overview sentence should give a very brief description of the research in the sub-project and should end with a clause that says “this will tell us X“.

The aims sentences should be repeated in the background. Each of them should introduce a discussion of the evidence that supports the assertion that this is an important aim.

The sub-project overview sentences should be repeated in the part of the case for support that describes the project in detail. Each of them should introduce the detailed description of the corresponding sub-project.

This checking and matching will probably take nearly a minute to do for the first aim/sub-project overview sentence pair but the others should be much quicker. It’s just a matching exercise after all. Lets assume it takes 2 minutes. You have a minute left, and only the dissemination sentence to check.

The dissemination sentence

The last sentence of the introduction should say what will be done with the results. It is the dissemination sentence. You need to check that it is repeated in the description of the project as the introduction to a section on dissemination. You also need to check that, if the importance sentence has a practical component then the dissemination must have a corresponding practical element. For example, if the project is going to discover a cure for a disease, the dissemination needs to promote the use of the cure in some way. As a general rule there must be a plan to disseminate the results in a way that makes it likely that the claimed practical benefit will be realised.

What to do with the outcome of the review

Only about 5% of grant applications will pass this five minute review. If you are reviewing a grant application for someone else and it passes, it should be pretty easy to review the detailed content. I’ll give some helpful pointers in a future post. It goes without saying that if the grant you are reviewing is yours, it is safe to give it to someone to review.

In the more likely case that the grant application fails the review, then it needs rewriting. If it’s yours, that’s pretty simple. Read my post from last week. Write the 10 key sentences and use them to organise the text you have already written. If you can’t write the 10 key sentences then you shouldn’t be writing a research grant.

If the grant application is not yours, you need to write a feedback sandwich. Basically the grant needs to be rewritten before it’s worth looking at the detailed content. I’ll say something about how to do this in my next post but whatever you do don’t use the phrase “completely rewrite”.